2022-3-22 Bulk Edit Working Group Meeting Notes

• Magda: The development status, there is not much information on this because we are now mixing Lotus and Morning Glory builds.
• Magda: We have added radio buttons instead of checkboxes. There is a bug. the drop-down should default to  "select record identifier." it should not default to barcode. Uploading the barcode file does not work just yet.

• Magda: We get an error message when trying to upload barcodes.

• Magda: We are working on that. There is some progress on the backend, but this is not visible to the UI. So please continue to be patient.
• Magda: On the Scrum Board, you can see there is a lot of other issues. There is progress for items, mostly on the backend.  And front-end developers are working on addressing bugfest issues.
• Magda: And this is the work on the backend on issues of displaying records and saving them.

• Magda: The main part of the meeting today, I would like to return to our discussion from the last meeting about the behavior of the action menu, depending on the permissions that they use has. Their permissions will differ between the in-app and CSV approach. After that, I would like to walk again through user records in the in-app approach. I would like to get your feedback on priorities for the next steps. I would like to go back to our conversation regarding the apps with bug edit capabilities that we touched on. Erin mentioned that none of them are actually apps. We will need to either rename them or the options in the accordion. If time permits we will get to the pilot project UIT.
•  Magda: So let me start the presentation. I'll start with a quick review of what we discussed last time. So we talk about the permissions that were introduced in Lotus, which was separate for edit, view, and delete.

• Magda: And depending on the permissions you had, the behavior of the action menu, once you open the application and you have a CSV type of permission. You could see right away--start bug edit. Even before the preview was populated.

• Magda: Once the preview was populated, you could download the matched errors or start bulk edit. And if the error accordion was populated, you would have the additional options of download errors in CSV format.

• 
  

  Magda: Please feel free to interrupt me at any moment, if you have an additional question.

• Magda: And this is the last screen for a CSV approach. Once the edit has been completed we see the completed process and you can start another by uploading another CSV file. So this is how it works in Lotus.

Revisit naming convention for Apps with bulk edit capabilities accordion

• Magda: Last week we also discussed that in the morning glory we will be introducing new permissions and we agreed that their names will need to be renamed in Lotus. The new ones in Lotus will be named
  • Bulk Edit: In-app- Edit 
  • Bulk Edit: In-app - View
  • Bulk Edit: In-app - Delete

• Magda: With in-app permission enabled – Navigating to the landing page the action menu is not available because there is nothing the user can do.

• Magda: Now we have uploaded the file. The preview is populated with errors. You see the following options:
  • Download matched records (CSV) - a copy of the preview of affected records
  • Download errors (CSV) - a copy of errors
  • Start bulk edit - will open a screen for in-app editing

• 
  

  Magda: Once the bulk edit is complete, what should be the actions displayed there? We discussed that it would have the option to save changed records in the CSV file and also saved errors.

• Erin: I have a question about this screen Magda. The green box success toast. Is that going to behave like a success toast, where it appears on the screen and then it goes away? Or is that going to stay on the screen?

• Magda: It will stay on the screen because I think you would like to have a longer notification, not something that will pass. And if you don't pay attention, you will not notice it. Do you have problems with this?

• Erin: No, that's, that's fine with me. I mean, others can chime in. It just wasn't clear to me from the screenshot.
• Magda: Yes this is the exact behavior we have right now. It does persist. And actually, there is a bug because it persists even into the next bulk edit.

• Erin: But let's say I do an update and for some reason, 340 work, and 10 of them fail. Is it still a green box?

• Magda: (summary of the discussion with Erin about this screen) Yes, but it will be a green box minus those that were not updated. So in this example, you submitted 250 entries. 248 records were matched, 1 was not updated because there was some error. And one was not matched. So you have here notification that one record was not updated of the 248 that has a match.

• Erin: So the error that appears on the screen is found before I push the ...

• Magda: Yes, but it's a matter of updating the mock-up. This actually should read instead invalid date for the status or something like that.

• Erin: Yeah. You would get a better error message?
• Magda: Exactly. And it will specify what went wrong and indicate the record identifier. And it will have the option to save those errors so you can go back to the records directly and see what went wrong? Okay. And the other questions?

• Magda: So this was the easy part of the presentation. Now the hardest part starts. Now we will talk about the case where the user has both CSV and in-app permissions, so they can do both.

• Magda: So the user has CSV and in-app approach. They are on the landing page. They have an action menu and they have start bulk edit (CSV). Does it make sense?

• Erin: Yeah.

• Magda: Okay. Now we are moving to a more complicated thing. We are in the inventory items and in inventory, we can only use the in-app approach edit. But they use it also have the permission to start bulk edit with the CSV approach, which is not fully applicable for items at this point. It's applicable only for users. So the question I have is, should this start bunk edit CSV approach display only when they are on the user tab, or should be displayed also on the inventory items tab when the user cannot do anything here with that?

• Erin: So I think in an ideal world, you would go to that landing page and you have an option in the action menu, but you would document or train people to say that the first thing you're going to do is you're going to select the app that you're going to work with.
• Erin: If I'm going to edit user records and I click that user users radio button, then I should see the action menus options that are applicable to users. If I choose inventory, I should see the option menu options that are applicable to inventory. And then my other thought is that those actions should be sorted based on whether it's CSV or in-app and not sort them alphabetically. So you would have a clump of CSV actions, and in-app actions. And maybe even playing around with labeling of the options because that'll make it even more clear that this is for in-app stuff and this is for CSV stuff.

• Erin: I think the chatter in the chat is mostly in agreement with hiding the stuff that you don't need in places where you can hide it. And then clumping the actions by a CSV or in-app.

• Magda: Great, thank you.

• Magda: So another question is, let's assume then that we are in inventory items and I have both CSV and in-app permissions, but I will see start bulk edit. Right? And then when I click the link and I switched to users, I will see a start bulk edit CSV option. Is this what you are proposing are agreeing or not?
• Erin: That makes sense to me (chat agreed).
• Magda: Now we are in users and we have both permissions.

• The summary of this section is best stated by Erin below after some back and forth with Magda.

• Erin: That's a good question for the group. If you have just edited 500 item records and now you need to do another edit with a thousand item records, a separate record set, how do you want to start that process over again? You could go over to the record identifier and click upload your file. One of the questions I would have Magda is can I get to any of these files after I've started a new load?

• Magda: All of them are stored in S3.  They should be in export manager. But I have not tested for how long they stay there.

• Erin: That's okay. I think we just need to get some clarity on it.

• Magda: But is that something that you would like to have?

• Erin: What happens if I accidentally closed the tab or I have to walk away and I come back in 30 minutes and suddenly I can't get back here. How do I get to my files? I think that's the question.

• Magda: They are stored. The matter is how do we make them accessible to you after a while. But when you are saying you want to access the files, you actually have those files on your local machine.

• Erin: I might not have the error messages. And some staff might change machines over the course of time to go show somebody something. It would be nice to be able to get to the file through a tool, an export manager is certainly available as an option. We don't have to go totally down that road because I know we were talking about resetting. Thomas said in chat that he would favor having some sort of reset or start new, start new edit, or something like that.

• Magda: Should we have an option to start over>
• Erin: I have a little bit of a hard time visualizing that at this point. So I'm not entirely sure. It might be interesting to make up a couple of options. Kimmy is favoring having some sort of reset button or reset option.
• Magda: The other option would be just clicking on the bulk edit icon to clear everything on the screen.
• Erin: I wouldn't want to do that because I would totally randomly do that adn screw myself over.
• Magda: Okay. So an additional option in the action manual, right?
• Erin: People in chat are preferring a button.
• Erin: f you want to see an example, in the checkout app there's is an end session button. So there might be a pattern there that you could look you, your developers could look at.
• This image was added post-meeting for convenience to illustrate the example referred to by Erin.

• Magda: But the warning should not be end session?

• Erin: I wouldn't call it end session. People seem to like reset.

• Leeda: If you go to inventory, in the left pane, you see the reset all button underneath the search button there. Is that what we're talking about?
• Erin: I don't like that because I think it's really easy to accidentally click that and get rid of the work that's on the screen.

• Magda: With bulk edit, we will be resetting everything, not just the left pane but the main pane, the notification, preview, and errors if applicable. We can talk about this more. Personally, I like the button idea and start over which may not make sense to others.

• Magda: So it looks like we are in agreement on the behavior of the actions menu, depending on the permissions.

• We will discuss this reset button probably next time when we meet.

Bulk edit - user records - in-app  approach

• Magda: I would like to work on the bulk edit user records in-app. Something that we discussed in early days of bulk edit.
• Magda: So the behavior right now, it's the same as we have implemented. The identifiers.

• Magda: Uploading the file

• Magda: Populating the preview

• Magda: And then start bulk edit.

• Magda: And here comes the in-app. 
• Magda: Select an option and it will be email, expiration date, patron group, and probably others that we have prioritized a long time ago with the users SIG. Permissions will be a separate feature because it is complicated. If we do the permissions, and I understand how important they are, we will need to do it in a separate story. It cannot be a part of user records. So please disregard permission, this row here (in the drop-down).

• Magda: Here's the list of the actions.
  • Find
  • Add to existing
  • Clear field
  • Replace with all
  • Find and remove these
• Magda: If we select find, It means you are searching for a string within a field. And then when we are replacing it with another string

• Magda: So that would build something similar to what we are planning to do for items, but it's more advance because of the find and replace option. We have that clear field and replace it with some other value. We can have replace with another value. And please disregard the permissions for now. Any comments?

• Erin: The options listed there are the fields that you can change?
• Magda: Yes.

• Magda: We may also take the approach that we will be implementing, starting with replace, clear field, with those two options that we will be supporting item and then other two existing, but under the existing will be applicable only for the repeatable fields. 

• Erin: I'm not sure about what the distinction is between find and remove, and clear field.

• 
  

  Magda: Clear field is where you clear, whatever it is, it doesn't matter. Find will find these values and remove them. It's more like a conditional.

• Sara: So I was also just needing to get a better handle on the different nuances of the differences because this is actually quite remarkable. To be able to find something in a field and replace it so discreetly is quite wonderful. And so you're suggesting that this will also be possible for items at the item level.

• Magda: In stages.

• Sara: Because find and remove these, if we could get this, this would be so wonderful. I have to do tortures things to be able to do this when I bulk edit certain fields.

• Magda: So we also may then discuss the priorities about that because we can start adding these actions to items to those fields that we have. And then once we have this action within one record type, we can easily use it for other record types. So we will need to determine what is a higher priority, this in app functionality for users, or build up the complexity of the bulk edits for items, holdings, and other inventory records.

Um, but we can have this exercise that prioritizing exercise later, but, uh, what I'm getting from you, you kind of like it, right? No, this is really wonderful. And I guess one other question, and maybe it sounds really silly, but. Uh, to existing, would that be add to existing at the end of existing or so maybe we need to just be really specific about that, uh, like a pen to existing or something, but does it really matter?

This was actually the append existing was added. I added it when I was still thinking of having the bare permissions, because I assume you may have a users that have a set of permissions, but you would like to add them. So the order of permissions really doesn't matter, right? If you have first, the inventory or inventory

permissions, it does matter. But to have it for other fields where the order matters, can you give me an example where the order would matters for items like for inventory? Uh, for inventory, I would say in my, um, Nope fields, if we ever get to item, note, fields, any other, um, you very often want to have like, um, I want the most recent one for.

Right or, or I want to know that this is always going to be the last note or always be the first note, because then if I dump it down in Excel or something and I'm chopping up my columns, I want to know where that certain bit of information is at differently. When you asked the note, I believe, I don't know if, uh, the notes contain also the timestamp when the note was added.

Uh, it depends on the type of note you're talking about. So because most of the notes and inventory are just free text fields on the record. So they have the metadata of the overall record. But if you're talking about the notes, modal, like it's used in users, then that note object has its own metadata.

I'm talking about notes within records, in different note fields, right? And, and, and Jen is pointing out in the chat too, that we're also talking about kind of two different types of, of fields that you want to work with. You want to work with a free text field like Sarah is describing, and then you also want to be able to work with controlled vocabulary fields, which is what permissions is because you want to use the control vocabulary of the names of the permissions.

Um, and so you might have need to define, you know, is there a controlled vocab field where the order matters? There shouldn't be because Jason, it shouldn't matter, um, versus a text field where the order matters, which I think are the examples Sarah is getting at where she might expect notes on her records to be in, in a certain order of information, um, versus.

You know, other kinds of records and things like that will also be, I think, applicable for the custom fields. That the way I see this a pen or two existing is for everything that is in the, in the, on the backend is an IRA. It's something repeatable and it assumes that the order of the elements DRA.

But this is something important to keep in mind. Um, we, and this, this really increases the complexity of some of this each app involved. You have to determine that the fields that can be touched and the options that can be used in the order, that those options can be applied and things like that. So there's a lot of requirements work here.

Uh, once we get to the, uh, added to existing, we can, uh, or, uh, this will definitely be a separate, uh, longer discussion about expected behavior. We can also do this again in stages. First approach would be let's assume that whatever we are adding to the existing, we are upending. So this will be the last one on the, on the list.

And at least it will be a consistent behavior. And then, and then we can. Um, tweak it for this. And Jen is wanting to suggest also that it comparison be made to the language that the data import app uses, because you don't want to have different meanings in different apps. So I that's a, that's an excellent point, Jen.

Yeah. Um, Sarah, did you have other thoughts? I know that your hand is still up, so I wasn't sure if you had anything else you wanted to add there. So that was good feedback. Okay.

Um, so, uh, I think we are. Good. When I have to send so far, uh, we will live in if you need to come back and talk about the most important part. Do you want this additional action support or do you want to implement some elements in the, in, in the users? Uh, we will come back to this. Uh, the last, um, is, um, this is the downloading, the previous saving the preview that you preview the records that are not updated yet, but this is how they would look like once you click save and close.

And here's a notification that a third Judah 300 records have been successfully changed. This is the original first mock-up. It has changed. Obviously this is moved on top. Um, we'll we'll need to do, um, uh, updating those to include the changes we've made so far. I think this is the last one, and this is the same thing.

Uh, updated records, downloaded girls  and matching records.

Second, this is the example of saving and the naming convention it's then the naming convention that we already implemented year, month, the date, the name committed to users and the name of the file that was used to trigger the bulk edit.

So we have 10 minutes left. I would like to go back to and they close the denotes. I would like to ask to spend a little bit more time on the accordion for the ups, uh, with the bug editing capabilities. Let me ask them here. So this is what we have right now.

Well, we had ups with bulk edit capabilities for now. We have users and inventory items. Um, later we'll, we'll have probably in the approach, we will be going, will it be inventory, uh, holdings, then inventory items. And then, um, I remember someone said, I think some clinicals, there is no, uh, circulation. Um, there is no acquisition, so, so can we, can we just call these record types?

Can it just be a list of like record types? Cause that's really what you're talking about. It's with circulation, it'll be loans requests. Uh, et cetera, with acquisitions, I assume it would be orders, forces, things like that. You're really talking about record types. And I think that's a clearer verbiage than apps here, but, um, I don't know what others think.

Jen says. Yes, that's really important because it has to be it, you can't just say order app because there's orders and there's POS right. And that's a huge difference we're talking, right. Instance versus item or something. And then the permissions, right. We will have hopefully permissions eventually. And then, uh, then the, the link between user permissions, the link between, uh, users and inventory and all those things coming down the road.

You are suggesting we do the, rename it to the records with the bank, edit capabilities instead of ups, I would just call it record types. I don't even think you need the whole phrase with bulk edit you're in the bulk edit app. People know that you're in that app. So I would just call it record types. I think that's clear

the chat seems to be in agreement with that. Okay. Quick question, mocked up. When you were listing them earlier, you said holdings and then items. I thought we were doing items next and then holdings. Uh, I, when I said holdings was in the assumption that items are over there, that

was in Milan for a moment, uh, for a beautiful moment for the I at some point called Nirvana. And I felt that would be so cool if we have a reviews that has, I think many releases get different than, I mean, I had a hardest time not calling faint flower, flame thrower. I think this was a path. Um, concerned about morning glory, because this is the first release that has space in its name.

Uh, I'm wondering how this will be handled, but hopefully going back to record types. So users, inventory items, inventory, holdings, then, uh, requests, then loans then, uh, orders, et cetera. Right. So the circulation acquisition, the so, but also I wouldn't put the record types in there until there's functionality.

Yeah. Yeah. So that list doesn't need to be populated until it's ready to be populated. So, oh, I absolutely agree because we just, we, right now we did it, uh, gray out, uh, to, um, show what's coming. But this is not a teaser for, for everyone. And I agree we we'll update this.

Okay. Um, so the last part of the, of this meeting was the pilot UIT. Uh, we continue to struggle, uh, with environments. Um, um, I was really hoping to have it done for today. Uh, we discovered another issue that is being worked. So I don't have an environment where we can do the UIT. In addition to that, the whole environment was reset a couple of times.

And to be honest, I'm not sure that the users we have set before us still, still there. So we need to rely on you to, uh, go through this exercise again. And I truly apologize for this, but, uh, We all are learning, uh, the, uh, the circumstances shift responsibilities and many engineers that were working in other areas are contributing, uh, to help others.

So please bear with me, but the link that the skier, it's still the, uh, acceptance testing survey that I would like you to, um, to review and provide your feedback. Um, once you start playing with that, If you have a chance, can you please take a look at this survey and let me know if the questions are clear or if you, uh, make, it would like to make an, uh, changes.

We have four minutes left. We can spend, spend those four minutes going through those questions and, uh, I will, uh, it will give me some, uh, sense of you've done it. This makes sense to you. So the first question is please upload a file that we identify as of the records that you would like to edit. Please try different types of support that identifier.

So not only served barcodes, but also external IDs, user names or user IDs. How was your experience?

Does it make sense or it's not clear. We are talking about the first step when you upload the,

when you upload the, can you zoom in a little bit? Yeah, I've read. Sorry. I tried clicking on it, but I don't get, I can't see everything then sometimes I have to read to be able to think. Sorry. Is it good? Is it the size of the font? Good enough. Yes. It's good enough. Thank you.

Yeah, I, I don't know what other things I, I, I might leave out of records. Please upload a file with identifiers. I don't know. It's records that you would like to edit. I don't know. Cause their record identifiers. I don't know if. Might be a confusion there. So, but you do list them out to maybe it doesn't matter, I'm just thinking out loud, but this is a good find that, you know, for me, this like identify as you need to say, what do you identify as, but if this is redundant for you or maybe please upload a file with, uh, identifiers for the records you want to edit,

I really appreciate the feedback and I will make the change, but

I just want to make sure that what I'm asking is clear. I know that the English may be better, but the question is, is it clear what I'm asking or it's not.

Yeah, fine.

So then next one is about the query. Um, we support, uh, a simple query, for example, status active or a pattern patron group. And you specify the name of the patron group. If you can run those, that would be really helpful and also provide, uh, if it worked as expected. I think in that instance, that upload would be better than identify, like please upload the records that you would like to edit by query.

I just think of that might be clearer.

Actually, you're not uploading here. You are running the declarer. So when we are here, this is here. We are in user up and

equal.

Um, eventually you will get the preview that populates the records, that map. So you, at this point, not uploading anything.

This is about changing the, the columns in the display, downloading the matching correct cards, modifying the records locally and uploading the file again, and then overall experience. And if you have any screenshots that you would like to share, please upload them. Unfortunately, I have to run to another meeting and you probably have other meetings as well throughout then.

Um, we will get back to this, uh, next time, hopefully you will be able to do an exercise one exercise together, and then you will be, um, you will be able to run those, um, tests by yourself at your convenience. Thank you very much for your feedback. This was another great meeting and thank you all. I see. I see you in two weeks.

Bye bye.