| UAT feedback review | - Feedback details: https://docs.google.com/document/d/1bH0ZMG2RZte_5Anl8t2-ApcDEUX1AzxzYXn0uUVBq60/edit?usp=sharing
- Magda: 28:38: But before we do this, I have a couple of questions for those who participated and those who did not participate. We got only four responses, which is definitely less than I was hoping for. I understand that the libraries were going live. There was a holiday and people were on vacation, and on top of that, there was the American Library Association Conference. I think to respond to the survey was probably half an hour of work, and I hope for our next UAT we will get better feedback with more responses. The feedback I got was awesome. People that responded provided a lot of very helpful information. So thank you very much for this. But I have a question for those that reached out to me for a login but never responded to the survey. Is this because of time constraints? Or did you run into issues that you were not able to overcome?
Lloyd: For me, it was just time at the library. You know, we're currently implementing folio right now. And things got pretty intense. And so I did ask for the login credentials. And actually, I started once or twice and then got waylaid. Magda: I understand that. I want to hear that to be sure it was something other than Bulk Edit. Because I'm concerned if it is just difficult to use for you. And if so, what else can we do? Lloyd: I don't think it was the result of the survey at all. It was just my time. Leeda: I would say it was just a combination of bad timing. Again, I feel bad because I was the one who pushed for two weeks. And then two weeks, couldn't cut it in this particular instance, but also my tendency, especially with a group of 15 to 20 of us, is to think, oh, somebody else's done it. That's just my bad habit. I can only promise to do better next time. - Ros: For me, it was a timing thing with going to ALA, and then we tested KIWI. I also had a new employee start, so I am stretched in other ways.
- Magda: There's one more person that didn't volunteer his side of the story. I'm not sure if we have this person on the call. I will reach out in a private message to get feedback.
- Magda: Okay, so let's start with what was submitted, and I will go in the order of how the application progresses, not necessarily the order of the submitted responses. So the first comment is about the landing page and the fact that there is no indication you need to select a Record Identifier to move on because otherwise the file pick-up/drag-and-drop is disabled. And the other suggestion to move the record types selection above the drag-and-drop area is even higher. I do believe we talked about moving record types, and we decided to leave it as it is because it is consistent with other apps like data export, and import. But I do believe that that approach to move it up would make the flow of the mouse better on the screen. What do you think about that?
- Bob: I remember the conversation. And I think I think consistency just won out over what is a better UI design. I'm of mixed minds myself. But I would tend to leave it to keep things consistent.
- Erin: I tend to vote for consistency as well.
- Mark: I'm one that commented on this. It was driving me crazy. Because things were not where they needed to be. So I understand the consistency argument. But for me, the argument I'm going to make is the usability argument. It's enough to drive you batty. I would do things and they just simply would not work. Because the right things weren't selected. And maybe it's just me not paying close enough attention, but to me, it is a real usability issue.
- Magda: I have to admit that I agree with you.
- It annoys me, but only if I'm logged with
- allow me to select between record types. Right now I'm logged into this environment with
- permission that gives me access only to inventory items. So the selection is done for me.
- The question I have for this group is
- have the permissions for all the apps?
Not all but they will have permission to lustres? Right? They might have - Erin: Maybe not all permission. But they might have clusters like users in circulation,
- inventory and orders, or something like that. So
so Yeah, IUnknown Speaker 7:05
agree with what Aaron said - Ros: I agree with Erin about clusters of permissions.
So Jen is saying, as - Erin: So Jenn is asking about where this pattern is elsewhere in
Yeah, - Jenn: I'm just trying to understand what we're trying to be consistent with.
- Kimmy is on the call or not might chime in
Unknown Speaker 7:33
I'm going to the snapshot, because I have Unknown Speaker 7:38
the structure of you have the preview, like and then running jobs, Jen. So I think that's it. Unknown Speaker 7:49
So um, the data import it's on the top, but you don't make any selection before the job here. - ...
- Magda: So in Data Import, it's on the top, but you don't make any selection before the job here.
 Image Added
- Magda: In Data Export, is also on top here. But again, you don't need any selection before you start making that.
 Image Added
- Jenn: I don't see how either one of those
- I think it's maybe more close to
- in inventory where you have the drop-down for what you're doing. And then you're searching kind of underneath it. I
- don't have a strong opinion about this.
- Is it sticky? I haven't played with this enough.
Unknown Speaker 9:12
we have Kimmy on the call. I'm sorry. Unknown Speaker 9:16
I am not sure. It looks like she's on the call, but she might be I am. But I'm having Unknown Speaker 9:23
some - it's a simple change, then maybe that's a UX win that can make this a little bit less frustrating.
- Magda: Do we have Kimie on the call?
- Erin: It looks like she's on the call.
- Kimie: I am. But I'm having some connectivity issues at the moment. So Magda, do we have to make a decision right now on this
- or can I talk to you?
- Magda: Yes, we can.
- We can come back to this.
- Magda: The other issue that Mark brought up, is that once you are on
- you can try to drag and drop files
- but it doesn't tell you that you
- before you can drop a file. For me, it is pretty clear that
- the file drag-and-drop is disabled
- and you need to do something. And it states
- "select a file with record identifiers here. Maybe we should add the label here, select Record identifier, or what do you think? What would be the visual cue? For the user, that user knows that this is the first step?
 Image Added
- Sara: Can you open the drop-down menu
briefly So this depends, obviously on the on your selection on the users, this are the user user ID, user barcode, external IDs and user name.Unknown Speaker 11:01
So can be a - Magda: The choices in the drop-down depend on your selection record types, e.g., Users or Inventory. For Users, there are User UUIDs, User Barcodes, External IDs, and Usernames.
 Image Added
- Erin: So Kimie is saying in the chat that
- the Record Identifier should have an asterisk? Because
here Yeah,Unknown Speaker 11:14
- I think people will understand that
- you have to choose something here.
Okay. - Magda: Okay, and we can easily we can implement this
is - Bob: Is there a way to have the system generate a message when you try to drop something
- on the file drag-and-drop window when it is inactive that says choose an identifier?
Unknown Speaker 11:39
Yes. Unknown Speaker 11:45
Okay, I still exist, - Magda: Yes. The asterisk is definitely the easiest way. And once we do the
- asterisk, look for the output
- of a message if the user misses it
Unknown Speaker 12:09
I think maybe if we move, record types to the top, since it's affecting what you can see in record identifiers, and then record identifiers come second, and then your drag and drop. Unknown Speaker 12:28
Yeah, that makes sense to me. Because if you're wanting the UX, the UI to guide people towards the order of operations, then you just put the stuff - Magda: So proposed solution?
- Leeda, Erin, Jenn, and Mark: All agreed that moving the UI to display inputs in the order of operations
Unknown Speaker 12:54
And I think that reordering would probably also solve Mark's problem, because it makes it logical. Unknown Speaker 13:02
I think that would go a long way to hell. Unknown Speaker 13:11
I wrote this in Yamo. So we know. So I know, - would solve all the issues discussed.
- Magda: I wrote this in Yellow so we know we need to come back to this.
 Image Added
- . We discuss this in March and agreed to this as a group. What are your suggestions? What would you suggest we do?
- Jenn: So this one was my comment
- . The reason I reacted to item effective location being there instead of the location fields, is that I
- cannot directly act on effective location. And it seems like I would want to see the columns that hold the values that I'm actually going to act on.
Unknown Speaker 14:29
can't act on effective comm number either, right. Unknown Speaker 14:33
But that's not even a choice right now. So I wasn't worried about it, like I was trying to do. I was like trying to do an actual task, which was changed the location. And so like for, you know, for a UX test, that's what I do the thing that will be a test. Unknown Speaker 14:52
So this is the point of the user acceptance testing, that you provide feedback like that. So should we get together again, or I can put the query and other query the survey. So we can discuss which columns should be available on the first load? And what, like, which one should be pre selected? And which one shouldn't be in the Unknown Speaker 15:26
maybe? I can't remember because like everybody else, my brain is soup right now. But did we ever do like a coat sort exercise or anything else like that? That might? Unknown Speaker 15:39
We did not what we did I think it was sometime in March, March. I don't remember the date. But this was in March, we can I would put together a survey, probably as simple a survey. And since we don't have a next week meeting, maybe we can, you can provide your feedback Unknown Speaker 16:02
survey. If you would like me to do that I can, I can do again. Some do because a Qualtrics instance, I can do a sort on a, I can make a survey. They're Unknown Speaker 16:13
awesome. Thank you, for the product columns in the I can send you the list of the fields, because obviously, there are more fields than there are here. And then we will discuss, Unknown Speaker 16:28
well, is it a card sort on the stuff that's here under Show columns or a card sorted on every inventory value? Unknown Speaker 16:36
inventory item along with what the group thinks? Should we stick to that those fields? Or should we expand? Unknown Speaker 16:51
Because I just feel like the item record has a lot of stuff on it. And I feel like Yeah, and I feel like we kind of we almost certainly have what we would want in this list. The question is, how is it ordered? Unknown Speaker 17:07
As I said, I didn't come up with this list out of the, we discussed? Yeah, obviously, we need to re discuss this. So once we are really discussing it, maybe we can start from zero and see what the group thinks. Okay, Unknown Speaker 17:23
I'll just say one other thing that was like part of this feedback, it's that this is the only opportunity you have to choose these columns. So even if you look at this, and you're like, Okay, this is fine. When I upload my file, it's changing, say, the permanent location. And I get to that next screen, I can't make location, yes, I have one of the columns, then I made him Unknown Speaker 17:43
appear. Unknown Speaker 17:46
The combination, I guess more than like picking the perfect lists, like if that second screen could have a change. So I could be like, Oh, I forgot to pick that then that would be you know Unknown Speaker 17:56
what I mean? I know what you mean. But I think to add the peak list on the other screen would be difficult. I'm not saying it cannot be done. I'm saying it may be difficult, I think it would be easier to implement to make it consistent. So once you select once you select your options here, once you select the columns here, the selection persists through all screens, through the usual form. And on the confirmation screen. So those are the columns you have selected. Unknown Speaker 18:38
I mean, another option here is to go minimal on what's displayed and make it more obvious that you can pick things to add. So that people are like, hey, there's no location here. And then they go pick which location they want to look at. Unknown Speaker 18:53
And I look Unknown Speaker 18:57
lamentation because I think that it so I like Jen's second her first proposal of potentially adding the picklist to the six The following screen as well. But if that's more complicated, then I think forcing us to actually open it and select what we need to see all the options and then make the all the choose what we need to see for this operation is the important thing because I think actually the effective location is really important to have it just because really in combination, all three are really important if that's what you're focused on. Because I think for example, if you're controlling your permanent location from the Holdings Record, that item actually says none for the permanent location. And so, yeah, so we wouldn't so to put permanent location there for the i would be kind of nonsensical to write like, as a default, you still have to open it and add more. So I like the idea of going minimal and really just forcing you each time to go. Okay, I have to choose what I need for this operation right now. Let me check off what I need, and being forced to make that decision, so to speak. I don't think that's a burden. Unknown Speaker 20:27
I would them, we will come back to this. Once we have a feedback from the from the survey, and we either do the way in volunteer with the Preakness or organizing the the fields. There is I'd like the option of bare minimum bare minimum to be displayed on this screen. But the question is, what would be the bare minimum? What? Do you want to have only barcodes? Or the what do you want to have to be displayed? And I do believe this would also be worried about we will about vary from scenario to scenario what what feelings are you planning to update? I will put Unknown Speaker 21:27
just looking at that list and I will save the bare minimum have a barcode and item HR ID, then I would like something that kind of prompts me so I don't panic. That's that. That's all I can see. They say please choose please select more columns here or something. Unknown Speaker 21:50
Yeah, I would say that too, is kind of like that identifier field, we need something to say select fire record, or whatever. You know, something that prompts it being up in the Actions menu is actually really far away from just that one thing in the middle degree. Unknown Speaker 22:11
Can you repeat? Unknown Speaker 22:14
So So when I'm looking at the screen, right, I have file name up top, and then I have preview of record match. And then I have errors. But the Action menu is really far away from indicating to me that this is how I select the columns, you have record matched. And just like we were saying that over for set criteria for record identifier, it just being blank is not helpful. It actually needs to kind of indicate to us it needs to prompt us by saying select Record identifier or whatever it was that we just agreed on, to prompt you to drop down in what you need to select. So it's almost like preview of record match needs also some kind of like little indicator select from fields. Like I was just speaking. Unknown Speaker 23:02
So KIM Yeah. So Kimmy saying in the chat, you know, we could just put a note that says Choose Columns under the Actions button. So you add some text there. I guess the reason I'm kind of feeling not great about this, these proposals is I think more that I would be more comfortable with it. If I felt like I could choose it, and then it would stick. In other words, I don't want to do this every single time I'm coming into the app, and dealing with user thing. So we get to the idea of like user fully renewed the user profile system, which it doesn't have right, to be able to save like my local customer preferences and things. So I just I do feel like the order of what is there make sense? In some contexts, it doesn't make sense in every context, but there are some contexts where it does. I think Sarah's point about the fact that sometimes the location fields are completely blank is also very valid, right? You know, and that may have been part of where we were when we were first talking about the list. What we could do is we could do a cart sort for all the columns that are listed. We could do a card sort for every field and inventory if we wanted to do that. And then we could do a question that says, What would you consider to be the bare minimum? And just, you know, choose these values, and we can see what comes back? Unknown Speaker 24:37
I thought the show column approach is consistent with other apps. I'm picking inventory because that's where I spend most of my time, but I know this is the behavior also in other places as well. So I would not expect this to be so I'm expected, I would say that if you don't see what you want to see, you would naturally go to action menu to select the columns. Unknown Speaker 25:14
And probably MACRA, you are absolutely right. We're all new to the system. We're all getting into the system. So we haven't been using it enough to realize that we're going to be being trained by each app to do certain things and to look for certain things in certain places, right? We're still learning where things live. Like, right now, I would say I would never have thought to click on Actions to find that information, you know, to find more things to add, but asked me in a month, probably it's the like, the first thing that comes to mind, oh, yeah, just click there and, or an ad that, I will know that. But we're also Unknown Speaker 25:54
I understand that this is a new product for you. But the approach of selecting columns is not specific. The behavior for bulk edit it is, Unknown Speaker 26:07
it's a UI pattern that's across Unknown Speaker 26:11
kind of likes the right my, my programmed reaction from our current system is to go to the ER and right click, but I don't see enough columns, you know, right click, and then the then this very show columns thing shows, is something to get used to. Unknown Speaker 26:31
I think this is just a different approach, because your current systems probably not what web base you are, you're talking to the client. And so I let me put in the user feedback is that we will follow up with the survey. Unknown Speaker 27:38
The next was about the record. This is important, and we have five minutes left, but maybe we can start talking about this. So this is the same file that was used by the person who provided the feedback, this feedback, and here's the behavior. The file contains 15 entries. Two of them are errors. So though, there are no matches for those two identifiers, so the 13 records that much the list here does not contain 13 Records much. The idea of the preview is to show Top 10 records. And the the way we discussed it, if you want to see more, you do the download master records, and you select and you'll see this in the CSV file. If this is not clear, and it needs to be readjusted, let's talk about this. Do you think the number of 10 is insufficient? It shouldn't be more if it's insufficient than how many would would satisfy the need. The other thing is, there is a bug right now because there is 32 it should show at least 10 is showing nine. So I find I found the back for this to find out why we are getting on the nine instead of instead of 10 The one thing that I don't I did not understand from the from the comments is about 11 marched with two errors. So was this day font file, or if the person who submitted it can provide a little bit more feedback, if they understand that that would be awesome I will reach out to the person directly. Let's go back and question of the preview- I was trying to do an actual task, which was to change the location.
- Magda: So should we get together again, or I can put s survey together to ask what should be pre-selected and which one should be on the full list of options?
- Erin: I can't remember because like everybody else, my brain is soup right now. But did we ever do like a card sort exercise or anything else like that? That might?
- Magda: We did not. What, we did, I think was sometime in March. I don't remember the date. But this was in March...
- Magda: I can I put together a survey, probably as simple a survey. And since we do not have a meeting next week, maybe you can provide your feedback.
- Erin: If you would like me to do that with Qualtrics.
- Magda: Awesome. Thank you.
- Magda: I can send you the list of the fields because obviously, there are more fields than there are here. And then we will discuss.
- Erin: Should the card sort be on the stuff that's here under show columns, or is the card sorted on every inventory value?
- Magda: Should we stick to those fields? Or should we expand? What does the group think?
- Erin: The item record has a lot of stuff on it.
- Magda: Since we are discussing this again, maybe we should start from zero and see what the group thinks.
- Erin: OK.
- Jenn: I'll just say one other thing that was part of this feedback. This is the only opportunity you have to choose these columns. So even if you look at this, and you think it is fine. When I upload my file, it's changing say, the permanent location. When I get to that next screen, I can't make the location one of the columns. If the second screen could have a change so if I forgot to pick something then I can add it. Do you know what I mean?
- Magda: I know what you mean. But I think adding to the pick-list on the other screen would be difficult. I'm not saying it cannot be done. I'm saying it may be difficult, I think it would be easier to implement by making it consistent. So once you select your columns here, the selection persists through all screens, through the "are you sure" form and the confirmation screen.
- Jenn: Another option here is to go minimal on what's displayed and make it more obvious that you can pick things to add.
- Sara: I like Jen's first proposal of potentially adding the picklist to the second screen. But if that's more complicated, then I think forcing us to actually open it and select what we need. To see all the options and then make us choose what we need to include in this operation is the important thing. Because actually, the effective location is really important to have in combination with all three location fields if that is what you're focused on. For example, if you're controlling your permanent location from the Holdings Record, the item actually says none for the permanent location. And so putting the permanent location there would be kind of nonsensical as a default. You would still have to open it and add more. So I like the idea of going minimal and really just forcing you each time to choose what you need for this operation right now. Let me check off what I need and be forced to make that decision, so to speak. I don't think that's a burden.
- Magda: We will come back to this once we have feedback from the survey, and we either will do the way Jenn volunteered with a Pick List organizing the fields. I also like the option of the bare minimum displayed on this screen. But the question is, what would be the bare minimum? Do you want to have only barcodes? Or what do you want to have to be displayed? And I do believe this would also vary from scenario to scenario depending on what fields you are planning to update.
- Leeda: I was just looking at that list and the bare minimum should be barcode and item HRID, then I would like something that kind of prompts me so I don't panic that this is all I can see. Something to say please select more columns here or something.
- Sara: I would say that too, it is kind of like that identifier field, we need something to say select identifier. A prompt. Being up in the Actions menu is actually really far away from the middle panel.
- Magda: Can you repeat that?
- Sara: The Action menu where I need to select the columns is really far away, and just like we were saying for setting the criteria for record identifiers, it actually needs to prompt us by saying select record identifier or whatever it was that we just agreed on, to prompt you to drop down and select what you need. So it's almost like preview of a record match also needs also some kind of like little indicator select from the fields.
- Erin: So Kimie is saying in the chat we could just put a note that says "Choose columns under the actions button." So you can add some text there. I think that I would be more comfortable with these proposals if I felt like I could choose them, and then they would stick. In other words, I don't want to do this every single time I come into the app to deal with user things. So we get to the idea of FOLIO needs a user profile system, which it doesn't have, to be able to save my local custom preferences. I do feel the order there makes sense in some contexts. It doesn't make sense in every context, but there are some contexts where it does. I think Sarah's point about the fact that sometimes the location fields are completely blank is also very valid. That may have been part of where we were when we were first talking about the list. What we could do is create a card sort for all the columns that are listed, a card sort for every field in inventory, and add a question asking what you consider to be the bare minimum, and we can see what comes back.
- Magda: I think the show column approach is consistent with other apps. I'm picking inventory because that's where I spend most of my time. But I know this is the behavior also in other areas in FOLIO as well. So I would not expect this to be so unexpected. I would say that if you don't see what you want to see, you would naturally go to the action menu to select the columns.
- Sara: And Magda, you are absolutely right. We're all new to the system. We're all getting into the system. So we haven't been using it enough to realize that we're going to be trained by each app to do certain things and to look for certain things in certain places. We're still learning where things live. Right now, I would say I would never have thought to click on Actions to find that information, to find more things to add, but ask me in a month, and probably it will be the first thing that comes to mind. But we are also...
- Magda: I understand that this is a new product for you. But the approach of selecting columns is not specific to the Bulk Edit app.
- Erin: It's a UI pattern across FOLIO.
- Magda: Yes.
- Leeda: My programmed reaction from our current system is to go to right-click to add more columns. It is just something to get used to.
- Magda: I think this is just a different approach because your current systems are probably not web-based, and you're talking to the client app. So, let me put in the user feedback that we will follow up with a survey.
- Magda: The next response was about the record count. This is important, and we have five minutes left. But maybe we can start talking about this.
- Magda: The file in this example contains 15 entries. Two of them are errors; there are no matches for those two identifiers. The preview does not show all 13 records that match the list. The idea of the preview is to show the top 10 records.
 Image Added
- As we discussed, if you want to see more, you would download matched records as a CSV file. If this is not clear, then it needs to be readjusted. Do you think displaying 10 records is insufficient? Should it be more? If it's insufficient then how many would satisfy the need? The other thing to note here is there is a bug right now because there are only 9 instead of 10 records showing in this example preview. So I filed a bug for this. The one thing that I don't I did not understand from the comments is about 11 matched with two errors. So was the result from a different file? If the person who submitted this comment can provide a little bit more feedback, that would be awesome.
- Magda: I will reach out to the person directly. Let's go back and the question of the preview.
 Image Added
- Sara: Is it possible at the bottom of the screen to have the option to page through more results--next?
- Erin: In this example from Inventory (see below), we are paging the whole screen. In the example in Bulk Edit above, you would need to page part of the screen because you have the errors listed below the preview. I don't think we have any accordions that do paging, but I could be wrong.
 Image Added
- Magda: Let's talk about what would be the best behavior. Do you want to be able to browse through all the records?
- Sara: I think sometimes the first 10 are not enough.
- Magda: That is why you have the option to see the rest via CSV.
- Sara: Yes, but it may be nice to just see the next 10 on the screen and not have to go through the download process.
- Bob: This is in-app. So we should not have to flip between in-app and CSV. If the system can perform adequately and page through the results, that would be best. But in Sierra, that was the problem, it showed all the results, but the performance was horrible.
- Magda: You nailed it, Bob. This is the balance with performance. On top of it, in Sierra, you were not doing all of this through the Internet. This is one of the reasons we decided to limit the number of records.
- Magda: We are on the top of the hour, and I see people need to leave. I see Amanda has her hand up.
- Amanda: I have a quick question. I don't mind the preview being a short sample list of all of the errors shown. If we have 15 errors, will it show all of them or only 10?
- Magda: You also only have 10 errors. And you can also download the errors in CSV.
 Image Added
- Magda: We will come back to this next time and also plan to do a survey about it because it is important, and I see this is confusing for everyone. I definitely like to avoid the situation where you do a large bulk edit, and you have to page through them in the UI. This is not something we would like to support. Let's talk about this more at our next meeting. Thank you all for the feedback. The link to the document is in the agenda for today's meeting. Please review and feel free to add any comments if you feel I missed something or if you need to add additional information.
|
