When uploading large file the progress bar stays in the same place for a while:
[Magda Zacharska] 10:39:15 I will move them to the next element [Magda Zacharska] 10:39:21 When we are uploading a large file of the identifiers. I'm talking 10,000 records, the progress bar stays in the retrieving position for a very long time. So there's nothing in the UI that indicated that something is happening, and the user may have an impression that the job is stuck on the back end. [Magda Zacharska] 10:40:06 However, we know that something is happening because we see the list of the process records increasing in the browser Dev Tools. [Magda Zacharska] 10:40:19 I was wondering if it would make sense to change the label here from retrieving to something that would notify the user, that so and so records were processed. [Magda Zacharska] 10:40:37 So that even though the progress bar is not moving, yet, we see that there is work that is happening. [Kimie (Keemee) Kester] 10:40:53 If the dots are animating there are some dots right next to the retrieving, then that generally means that something is happening, even though the devs can't move that blue bar at least that would give the users some hope that something's happening is that what you're saying? Are you saying they can't even animate the dots? [Magda Zacharska] 10:41:19 No, no, they are, and they are animating. I just think this is a little bit too small. I would hope to have more visual information because the first thing you see is the progress bar and that it looks stuck. [Kimie (Keemee) Kester] 10:41:40 Well, you know, we could change the design of that if the issue is at the back end; they cannot calculate when to move that blue bar which is what I think you're saying? [Magda Zacharska] 10:41:52 Yes. [Kimie (Keemee) Kester] 10:41:52 Then we could, you know, okay, I guess this is what you're asking. [Kimie (Keemee) Kester] 10:41:59 Maybe you want to change the labeling, but maybe what we could also do is we could change the way that those dots are styled so that they're bigger, bigger could look more exciting. [Erin Nettifee] 10:42:14 I was not even aware that you would be able to track the progress that way in browser developer tools. So that makes me wonder if you could even expose the number counting up. [Magda Zacharska] 10:42:31 So this is what I want. This was my original question actually, if it were to be helpful if we show like 100 record process, 200 records processed, etc. [Erin Nettifee] 10:43:19 Yeah, I think that if there was a way to expose the count of records, something like 600 of a 1,000, you know, or to kind of show that it's counting up. [Erin Nettifee] 10:43:39 I also think, though, that that might be a little weird. [Erin Nettifee] 10:43:43 If you're doing that, and you also have this very tiny bar that's not moving right like that could also feel strange. [Kimie (Keemee) Kester] 10:44:25 Then why can't they move the visual blue bar forward if they have a count? [Magda Zacharska] 10:44:39 Because at this point there are 2 steps. First, they're retrieving the records. Then they are saving them in the file. And that is stored in the module locally. And this is the file that is being presented to the user. [Magda Zacharska] 10:45:02 So right now they're retrieving. It is not even if they retrieve, or 10,000 records, the work is still not done because they are still saving. They need to save, and this is once they start saving than the progress bar progresses. [Kimie (Keemee) Kester] 10:45:30 Hmm. [Erin Nettifee] 10:45:48 There are a couple of people in chat saying that they would like to see the numbers. That would be helpful. [Magda Zacharska] 10:45:59 Okay we think about that, we'll probably come back to this there later. [Magda Zacharska] 10:46:10 The next question that I have is related to the work we ae doing for queries. [Magda Zacharska] 10:46:27 And yesterday, talking with the developers, I was made aware that the part that is highlighted in in blue is a very expensive call. [Magda Zacharska] 10:46:42 This is the tool that will allow users to build the the query. [Magda Zacharska] 10:46:52 Once the query is built, this is the table that you see above the test query button. [Magda Zacharska] 10:47:27 And here we see the preview of 100 records. [Magda Zacharska] 10:47:34 The preview can be scrolled down where you will see 100 records [Magda Zacharska] 10:47:42 But I do believe it's important from the user's point of view, to know how many records will be returned. [Magda Zacharska] 10:47:51 I was told by the architects that this part is extremely resource greedy because it would require that the query tp actually run. [Magda Zacharska] 10:48:11 So what the architects proposed was to specify that the query will return more than so, and so records when I heard that it brought the memories of the inventor search when in early implementation of inventory where if we had a result of more than 10,000, that could mean 10,000 or 10.001 ro 10 million. So the question is, how important is it to have this information in the preview? [Magda Zacharska] 10:49:12 Do you need to know at this point how many records match? [Mark Arnold] 10:49:23 It would be my preference that we did. I do not expect Bulk Edit to be a fast thing. So, waiting for a bit to get the exact number of records for me would not be unexpected and I would prefer to see it. I want to know that the scope of what I'm doing is right. [Magda Zacharska] 10:49:44 Yeah, I agree with you because it really matters if your query returns 1 million records when you expected 5,000 records. Then you would know something is not as expected and you would adjust the query statement to narrow down. [Erin Nettifee] 10:50:06 Right. There's agreement. People are agreeing with Mark in the chat. Yeah. [Magda Zacharska] 10:50:10 Okay, great. The other point that the architects made is if it is important to provide the number, then actually, this preview would be running the query, so we are not gaining anything by previewing 100. [Erin Nettifee] 10:50:42 Is that specific to users? Or is that a generic thing across FOLIO? [Magda Zacharska] 10:50:48 No, it's a Postgres issue not just user records type issue. [Erin Nettifee] 10:50:58 So Thomas brings up the point in chat about whether we might slow FOLIO down or slow down a particular app. [Erin Nettifee] 10:51:11 If we have a record I think it's more likely to happen. [Erin Nettifee] 10:51:14 Maybe more likely with inventory than with users. But you know, if we inadvertently start a query, that's gonna pull 40,000 records instead of 400. I don't know if that's a concern [Ann-Marie Breaux] 10:51:25 I think that's a valid concern. [Ann-Marie Breaux] 10:51:29 If you started a query accidentally to show me all books... [Mark Arnold] 10:51:33 But if you use the the API with a limit of 0, it doesn't return all the records? [Mark Arnold] 10:51:40 It simply returns the number of records that would be returned. [Mark Arnold] 10:51:43 I guess I don't completely understand what the issue is. [Mark Arnold] 10:51:46 I mean, I know that when you do an API call with a limit of 0. It does take some time, I mean, it still has to find those records to return the count, but it's not returning those records. [Erin Nettifee] 10:52:01 Right, but it's still not an easier search to do. It still costs the same. It's just that the return comes back different/ [Mark Arnold] 10:52:08 Sure, but I do it all the time in production during the day when I'm working on another project and another job, and it doesn't cause any problems that anybody's told me about. [Erin Nettifee] 10:52:19 I think it would be at bigger institutions. [Magda Zacharska] 10:52:21 So, I want to clarify. We are talking about the preview. So the question is for the preview. If we want to know how many records will match the query, this is running the query, and we are on the screen when we are previewing 100 records, it's at this point we need to run the query, because we want to know the whole number. So the question is, do we really need to preview? [Magda Zacharska] 10:53:03 Or should we show all of the records here? [Erin Nettifee] 10:53:11 I I can't do anything with the records here. So I guess I'm not sure what previewing all 5,600 records here would do for me. But others should definitely chime in. [Thomas Trutt] 10:53:38 I would tend to agree. I think, showing the first 100 records probably would be enough when you're pulling 5,622 complete records through the AP. I know the back-end query is going to be the same but your response time is going to be a little bit slower, and it's also going to slow down the UI, and that would be my fear is showing off a huge amount of records. And this would really show down the UI for not really any benefit. [Magda Zacharska] 10:54:07 So we will show the all records. Once you click run query, it will take you to the Bulk Edit landing page where you can paginate through the record set. [Magda Zacharska] 10:54:26 What will happen behind the scene is that at this point, you are only interacting with a copy of the records stored in a local file. You are not making database calls. So this is how we will address the issue of constantly pulling the database and impacting the performance. [Thomas Trutt] 10:55:01 I think that makes sense [Magda Zacharska] 10:55:08 I see Jennifer, asks if there's a download option. Jennifer, is your question about downloading the results or downloading the query? [Jennifer Eustis (she/her)] 10:55:22 I know when you search on the identifier we can download the matched records before you do anything. I was wondering if there was something similar here. [Magda Zacharska] 10:55:37 Yes, yes. So the functionality that exists for identifiers will be supported for query results as well. [Jennifer Eustis (she/her)] 10:55:47 Okay. So I, I think, having just a preview of like the first 100 or so records is fine, because we have that download option. [Jennifer Eustis (she/her)] 10:55:57 So if you have like, 10,000 or however many, then you can download the complete set of matched records to really comb through those. [Magda Zacharska] 10:56:07 But you will not have all the records when you are on the preview screen. You will only have this option after you run the query, and are in Bulk Edit. [Magda Zacharska] 10:56:27 Let me find the mockup so what I'm talking about is clear. [Magda Zacharska] 10:56:57 So this is the screen we are talking about right now, then. [Magda Zacharska] 10:57:01 So when we test the query we are at this point seeing a preview of 100 records. [Magda Zacharska] 10:57:16 The the user clicks run query and the progress bar probably appears because we already have the file. [Magda Zacharska] 10:57:28 And the we are at the Bulk Edit form the landing page. [Magda Zacharska] 10:57:37 Here are the records. You can paginate, but you also have the download records in CSV format. [Magda Zacharska] 10:58:06 So we agree that the query should return the exact match of records is important, and we definitely need that. [Magda Zacharska] 10:58:24 Thank you for this, and we have 2 min left. [Magda Zacharska] 10:58:29 We will not be able to cover the query examples. [Magda Zacharska] 10:58:35 I just one that to point to that I started creating a JIRA with a list of possible searches by the record type and property type. [Magda Zacharska] 10:58:54 This is how the how we are going to develop the tool. [Magda Zacharska] 11:00:18 Please take a look at this document, and we will start our next meeting by talking about those searches. [Magda Zacharska] 11:00:28 If you have any comments, please let me know in the meantime. [Magda Zacharska] 11:00:33 Thank you all for your time and your feedback and I'll see you in 2 weeks. [Magda Zacharska] 11:00:40 Thank you. |