Skip to end of banner
Go to start of banner

2022-8-23 Bulk Edit Working Group Meeting Notes

Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 28 Next »


Attendees (please add your name):

Magda Zacharska leeda.adkins@duke.edu Amanda Ros Jennifer Eustis (OLD ACCOUNT) Erin Nettifee Monica Arnold Kimie Kester Erin Weller  Lloyd Chittenden Timothy Dannay  Sara Colglazier Jackie Magagnosc Jeanette Kalchik Christine Tobias Autumn Faulkner Donald Depoorter Robert Scheier

Note Taker:

Robert Scheier  

Meeting Recording:

Discussion:

Topic
HousekeepingMagda  02:31
I would ask everyone who is present today to add your name to the attendees' list. That helps later on when we discuss things we discussed in the past. A quick reminder that we have a Bulk Edit session in Hamburg on Wednesday, August 31, at 4 pm Central European Time, it's 10 am. Eastern Time. It will be a Hybrid meeting, which means it's for in-person and Zoom attendees. And the last housekeeping item is we are not going to have a meeting on September 6th, I will be on vacation, so I will not be available. If you have any comments, questions, or suggestions regarding WOLFCon, please feel free to reach out to me anytime, unless you want to speak up now and say something to everyone.

Development updates

  • Buk edit  - Morning Glory Bugfest tickets:

 

type key summary assignee reporter priority status resolution created updated due
Loading...
Refresh

Magda  06:09

Let's dive into the Morning Glory bugfest tickets. As you see, the list is significantly shorter than last time; we have three remaining stories. Two of them are in code review. One is in progress. All of them are related to making MOD data export horizontal scaling. And the issue is not only for Bulk Edit but also for other modules that use it for exporting reports, e.g., EDIFACT exports, eHoldings exports, Circulation log, and Bursar information. All of them are using this module. So the work we put in here will benefit others as well. The other good news is that we were able to resolve the issue where once the Bulk Edit completes, the confirmation banner needed to be manually refreshed to provide the number of records affected or updated. This is done. We are not able to recreate it anymore. So it's good news. The links to the performance tests are here, they have not changed since the last meeting, and we will definitely be doing more tests once those three stories regarding horizontal scaling are addressed, and we are sure how the system behaves when we have more than one module available. And the questions?

Erin  08:16
So the other two things that are listed as known issues, it looks like we're going to talk about one of them, the other is going to be worked in no Nolana?

Magda  08:25
So the first, 122, will be worked on in Nolana. 

  • UIBULKED-122 - Implement logic for record counts when items bulk edit is triggered by holdings id

The second one, 203, is in progress now. The developer is looking into it. If ,we find a solution for this and we can squeeze it into Morning Glory then we will include it there. The issue occurs when you try to upload more than 3000 user records, which if this is the case and we we are not able to fix it in Morning Glory, I still feel it's okay if we move it to Nolana. I will know more about that at our next meeting.

  • MODEXPW-203 - "Fail to upload file" error with large amount of Users barcodes

In terms of the development status, if we look at the SCRAM board, in addition to the bugs that we are addressing from bugfest, the team is also working on the backend functionality for Nolana so that UI work can start in the sprint that started yesterday. So we will be addressing issues in Nolana. The links are here if anyone wants to review them. if you have questions please let me know.

Expected behavior for: 

  • UIBULKED-122 - Implement logic for record counts when items bulk edit is triggered by holdings id

Existing behavior: 

Magda  10:30
So I would like to move to the expected behavior for the bulk edits-122. I have slides here and I can also demonstrate the behavior if this is not clear. So what is happening right now, is that if we upload a file with 25 holding records, and out of those 25 Holdings, only 20 holdings find a match, there are 5 errors with no matches. So does this result screen make sense?




Erin  13:03

So what can we control here? Can we add a blue eye and show information? What are we able to do to try and provide clarity?

Magda  13:22
Just tell me what you think would make sense. And then, I can discuss this with the developers.

Erin  13:33
Lita chimed in the chat, and I definitely think more people should talk. But you know, that's valid, right? Y

Lita  13:43
This is a case we are used to seeing when you're working with holding IDs. And in this case, you want to edit all the items associated with those holding IDs. Some of those holdings are going to have more than one item.

Magda  14:02
Yes. And we will have the same behavior if we start, for example, editing holdings by providing instance IDs. There are many other use cases for this. So I just want us to devise a solution or approach that would make sense so that it will not confuse the user. Bob has his hand raised.

Bob 14:34
Yeah, I just want to be sure I understand the confusion. Is it because the user knows they loaded 20 and see the number 24?

Magda  14:45 - Magda clarified the issue with the displayed results again.

Erin  16:27
So, my first suggestion is, rather than using the word records, can we use the name of the identifier? Or say the name of the thing we're talking about, e.g., 24 item records, 24 or 24 item records matched, and five holdings UU IDs errored, or errors.

Lita  17:01
I don't really have a problem with this top screen, because I can see here in the column that says barcode if I have a barcode, I'm on an item. I would start to worry is if I had fewer numbers than I submitted.

Magda  17:25
This may happen as well, because if out of those 20 holdings, there were some holdings that did not have associated items, then you may end up say, 18 items, for example.

Erin  17:50
So I think adding the name of the record type in front of "record," and the type of the identifier in front of "error" would help.

Magda  18:01
Okay, so the top level would be 24 items records match. And on the errors, we will have 29 entries, and I need to investigate how we got to the number 29, to be honest because 29 is nowhere to be found here. But this is the bug on the technical side.

Erin 18:55
24 item records matched. And then you can say five UID errors. Or, yeah, I don't know the best way to handle plural versus singular there. I'm sure there's guidance somewhere about it.

Magda 19:15
Would it be okay as holdings identifiers errors?

Erin  19:21
I thought it would be easy just to use the name of the identifier, but I don't have a strong opinion about it. If anybody else does, please speak up.

Bob  19:34
On the left, you're using the term holdings UU IDs.

Magda  19:38
So you would like to preserve this naming? Correct?

Erin 19:44
I just think it would make sense in context. It looks like Christie has her hand up.

Christie  19:56
My question would be, are the errors always going to be related to the holdings UU IDs, because I can imagine that there is a holding with an item, and there was an error with the item?

Magda  20:13
You will see all the errors that occurred while matching the provided IDs.

Christie  20:28
So it will only be the holding UUIDs there?

Magda  20:35
In this case, the errors that are here will be IDS you have provided that don't match.

Chrisie  20:44
So my other question is, what happens if you have a holdings ID and it's got 10 items, but only nine items show up because one of them had an error? Would you even know about that?

Magda  21:09
This is a very good question. And why do you think would not? Why do you think that one of those would not show up?

Christie  21:25
That's a good question.

Erin  21:27
All that's happening here is you're giving a set of holdings record IDs, and then it should just return all of the item records that are on these holding UUIDs.

Magda 21:40
But this is a good question. So, for example, if, let's say, one of the item records, has some invalid data that prevents rendering it in the UI. Christy, is this the scenario you have in mind?

Christie 22:02
I didn't really have a specific scenario in mind. I was thinking about this from a quality control standpoint. How will I confirm that I'm changing everything I expected to change? And, looking at the errors, I would be really surprised if we'd never have that happen. And this scenario you gave is actually a really good one because we're finding that some of the data we migrated with is just not standing the test of time as we migrate from one version to another. So I think it's perfectly reasonable that we have items out there with data that will go stale and no longer be valid in the system or is corrupted for some reason. And you know, what happens in that scenario? And I would expect it to show in errors that, you know, there was one record that we couldn't pull for whatever reason.

Magda  23:16
So, in this case, let's say we have one item that did not show up. So we would add here a barcode and the comment, data corrupted. And then, you will need to know which is the value for holdings and which is the value.

Erin  23:44
In Christie's scenario, you might not even get a barcode back.

Magda  23:49
But you will have the UUID.

Erin  23:56
My question is, how does Bulk Edit know how many items it expects to get?

Magda  24:09
It doesn't know. It just gives you this is what it found for what it was given. We can track the errors that occur in the process. It will be kind of difficult to recreate this issue with the data. But let's come back to this at some point.

Bob  24:47
I just have a quick question. So what's happening down below under the errors is a simple match on the UID in the spreadsheet to the UUIDs in the system. So no items are really being checked. It's just a simple comparison. So, it doesn't come into play regarding this error message down here, right?

Chrisite 25:22
It may come into play up above when we're trying to display the items. But it won't even do that, because it's it didn't, I'm sorry, yeah, so it makes the match. And there are five items attached to the holdings. And he tries to display it in the upper section here; you might get an error, right? If it's corrupted or whatever way at all.

Magda  25:48
When the user saves all matches locally, if there is a problem with one of those records, that may cause a problem down the road. I would like to table this and come back to this conversation. Let me think about this. For now, obviously, we will not handle this case; the record will be excluded unless the problem is such that will prevent users from saving the matches found. I will come back to this. But this was a good point, Christie.

Bob  27:23
Can I just add one thing I thought of in terms of the messages about the record numbers in the result? It just occurred to me that a single box with multiple lines describing the results in one place might read better. Reporting the results of every type of record that returned and the errors, all in one place so you're not scanning in different places to make sense of the numbers. Just one idea.

Magda  28:36
Okay, we can talk about this too. My understanding is that if everything goes fine, if there are no errors, and you see this top 24, this is all you really need. And when there are errors, you have them in one place, followed by what went wrong. But I put this also on the list of things to discuss how to make it a little bit more prominent or the reporting more prominent. Are we any comments in the chat that I need to discuss before we move to the next part?

Lita in Chat: When we download a CSV of the preview file, do we get only the columns chosen or all the columns?

Magda 29:36
We get everything in CSV format, whatever is in the item record.


UXPROD-3704  - Bulk edit holdings record locations - Survey results

Main questions to be discussed:

  1. What is the best way to present call number in the preview and confirmation screens?  Should each element be in a separate column or should they be combined in one?  What are the pros and cons for each approach?
  2. What is the use case for displaying holdings statements in the preview and confirmation screens? How should multiple values be concatenated?
  3. What is the use case for displaying holdings notes in the preview and confirmation screens? How should multiple values be concatenated?
  4. What is the use case for displaying Electronic access the preview and confirmation screens?  Should all the elements of electronic access to be displayed?  How should multiple values be concatenated?
Further details of the survey results available here

Magda
I would like to start with a few questions that were reoccurring. Several responses to the question about call number display in the preview adn confirmation screen indicated a preference to see each call number element in a separate columns. And I would like to understand what the use cases are? Why do you think it should be separate? We can do this, but I just want to make sure I understand.

Jackie
Well, we can one thing is that that's how you can tell, like, maybe you're doing this because somebody put the prefix in the column number field instead of a prefix field. And if you have them all together, you can't actually...

Magda
Yeah, it makes

Erin
That's an excellent example.








Sill working on notes



Unknown Speaker  6:14  
You're only seeing 10. Right.

Unknown Speaker  6:19  
Can you know,

Unknown Speaker  6:22  
that I know have this

Unknown Speaker  6:22  
problem? So I mean, but this is a good point. That if you combine everything you will never know, what is the part of the con number? And what is the part of the of the projects? And I think, Sara, Chris, hands up or No, no,

Unknown Speaker  6:43  
I was not. I was asking about that. Because I wasn't understanding what we were meaning by the elements. So if I wasn't sure if we were talking about the bass and the cutter and the year or, you know, if we were trying to break it down really far, or if we were just talking about the type the prefix Oct the suffix. So those are different elements. Yeah. And I think the examples are exactly right. If if I need to do a cleanup job around what is fully on, but does not fully put that as an oversight in the prefix, then that needs to be separated.

Unknown Speaker  7:23  
That makes sense. Thank you, Bob, you have your hand.

Unknown Speaker  7:28  
So are we talking about just this preview screen of 10 records? Or are we talking about the download file? Did download

Unknown Speaker  7:35  
file, we'll have everything and it will be structured like the record is structured. So you will have everything separately, the prefix call number and suffix will be done separately. But we are talking about preview we are talking about are you sure form and we are we are talking about their confirmation, and all those places when those records are being displayed. Okay. Thanks. So the that was great. That really helped me understand the other question, and we are still talking about the preview, are you sure and configuration screen one of the option someone mentioned that would like to see their holding statements. That was Duke and

Unknown Speaker  8:35  
holding statements and holding notes. So I checked in with my leader who wants who helped me fill out this survey. And she said both types of data would be useful for analyzing the scope, ensuring accuracy and troubleshooting when needed. But again, since we're just talking about a 1010 to 20, item preview screen. I think as long as we can get to it on that CSV, we're fine.

Unknown Speaker  9:12  
Why not? CSV, you will see everything everything right. The My concern is that if we are holding statements and notes, I don't know how lengthy those notes can be.

Unknown Speaker  9:26  
Again, she said it was alright for concatenating the summary statement and then for the holding notes, I think just the presence or absence of a note. Okay, wouldn't be fine. Kind of a yes, no, there are notes. Again, it's just a case of when we get ready to run a bulk edit. Note there's not inevitably but often there can be records in there that we didn't really mean to hit and sometimes the the summary holding state may not be not as serials. cataloger. But it can just kind of a brief look. And seeing the statement that's present there and the volumes that are included in it, you can say, oh, that I didn't mean to catch that one or

Unknown Speaker  10:16  
nods, leader to make sure. Do you want those to be columns in the preview?

Unknown Speaker  10:32  
The feedback I got was yes, but I'm not sure certain that the that they understand that you can capture that in the CSV, because what are the chant? You know, I don't want to base my entire decision predictably editing serials holdings on the first 10 records. And yeah, I wouldn't want to download that whole thing. And then, you know, hide some of the columns, I wasn't interested in and focus on the ones that was. So I will get back to you on that one. Sounds good. If I had to make an executive decision, I would say it's not. not absolutely necessary. But I do like the idea if we can do it have a presence or absence? Kind of like a yes, no, and then download the whole thing to find out what's there.

Unknown Speaker  11:28  
Okay. Other have any comments on this? What about electronic access? This was also mentioned an electronic access caste several fields. If we add those columns, that would make the display pretty difficult. So how do we concatenate two we leave them out the electronic access? What would be your suggestion for those? Is this also leader coming from you

Unknown Speaker  12:24  
don't recall that coming for me. But I could see again, that it would be more for ensuring that you're, you're touching the right records. Because I know in Dukes case, we have a lot of titles where we hold the print and the electronic. And we don't want to be touching the wrong title in that case. So it's not really a matter of all the elements, but just a way to flag it to say, hey, this isn't an E resource and not a print. Or vice versa, some print could get

Unknown Speaker  12:58  
caught up in your E holdings. Go ahead, sir.

Unknown Speaker  13:06  
So, it just, and maybe it's just because I didn't sleep very well. And so I'm not understanding. So this, what you're these things that you've outlined here, are, are specific to the previous screen, where we only see things right. And, and so I guess, again, I'm going back to to me, that's not preview, that's a selected preview. So that's really good. Anytime, I would be wondering whether I had the right records or not. And as soon as I had a lovin that I wanted to effect change on, I would not rely on the Preview, that I would have to download them to make sure that I wasn't changing something that I did not intend to change. And then in that case, and then if I'm understanding you correctly, then you're saying well, then every anyways, everything will be there. Right? Am I understanding that correctly?

Unknown Speaker  14:12  
That's correct, that all Holdings Record will be in CSV file.

Unknown Speaker  14:19  
Right? So So again, it kind of, you know, and I hate to be such a downer, but it goes back to I'm not really sure. In this case of not being able to only be able to see 10

Unknown Speaker  14:36  
It's so clear to me how help

Unknown Speaker  14:38  
confirmation screen will be actually actually and if it's not helpful, then maybe, or it's not that helpful. Maybe then it's not worth putting so much time and effort into getting all these fields exactly right or including too many or too few. Like I'm just also thinking of like working effort and the actual benefit. So I'm just I, somebody who was seriously done.

Unknown Speaker  15:15  
And my thinking is running along the same lines as well as Sarah, I know that the to view it. As you said some abrogated preview is not something you not only yourself, but I get the feedback from many, it's not enough. So to make you feel a little bit better, we are planning on changing the preview, that will allow pagination to the results, etc. But this is not happening in the Mallanna, it will be coming down later once we start building the query query tool. Because when you submit the list of identifiers, we can assume that those identifiers were based on some either query that you run in some other way. Or you have the set of copies in front of you, and you scan the barcode and you have them. So, you know what, that is the dataset you are acting on. Once we get to queries, when you will be running the queries, then top 10 is not going to do anything for you, because you will need to see, okay, what are the results of my of my query? And this is when we will be going to make changes on the on the preview what we can do what you can see. But this is not No, Lana, we may start talking about this in Arcade and then follow in that puppy. I think it's the name of the following results released. So it is something in our pipeline, it is just not available here. So going back, do I understand what you're saying that since the preview is only abrogated preview, and if you want to see you will need to go to CSV anyway. So there is we can be a little bit more less stringent, we can be less stringent in defining what fields need the need to be because you still will need to go into the CSV is this correct? Yeah, I think so.

Unknown Speaker  17:56  
Six, the word you might be looking for is preoccupied. Less free art preoccupied with the preview call.

Unknown Speaker  18:06  
Sarah, your hand this app.

Unknown Speaker  18:09  
I just wanted to follow up briefly on something that you just think it's worth noting. So I'm just because I have a stack of 20 books, and I can scan their barcodes into a file and I physically have them that does not necessarily mean that I know what is in their records. Right. So and I think this is worth noting because this happens to me all the time. So I get a list of barcodes people want them to go on display right? So I'm changing look temporary location. A pop up note for the circulation people are is also supposed to go in only sometimes it turns out there's already information there. And so then if I do a bulk thing without checking first whether or not that field already has information, which I cannot tell from just having the physical book in my hand, I will provide that information. So even we cannot assume or we should not assume that just because we have a stack of something physical that I know efforts. I hope that's

Unknown Speaker  19:21  
very good. That's a very good point because I didn't think about it that one thing is the copy and the other one is the record and they are not this this is good, good point as well. So, if I still would like to take a look at the questions that I have specific from the responses to to the survey, so again, we are talking about identifiers here. This is the list when you submit The identifiers. And in the responses I got one option to have the OCLC number. And my question is, is this the OCLC number on the holdings or on the on the instance level? Is there a OCLC number on holdings level?

Unknown Speaker  20:21  
No, only it's only on the instance level. Okay. The mark from the mark source. Yeah.

Unknown Speaker  20:27  
Okay. So I think someone who suggested OCLC understood that the we submit the list of OCLC numbers to identify instances and then from instances go to holdings, this is something that we will be addressing through the query. So I will table this for now, as well. The next question was about the columns. And this is how i This is the responses I got. And I assign three points to someone that was marked as important somehow important, good, two points and non important zero. And this is the list that I got the six core six columns that need to be listed, which is permanent location, HR ID, temporary location, then it's the call number without the prefix and suffix and then effective location that is currently not populated in under holdings level and Columbo with bracket and suffixes. Based on our conversation I, I see that we need to put a call number with graphics with all elements in the separate columns, including their card number type. So we call we talked about this column member holding statement we talked about the holding statement, electronic access. My concern is if we add the electronic access to the preview, the rendering will be will be difficult at this point.

Unknown Speaker  22:29  
And then the following questions are similar, some of the user some of the respondents, one of the respondents suggested let's have let's let user manipulate the order and that would be the long term goal. It's definitely not happening for an alumna. So, for now, we need to have a pre predefined list of columns. And the last question was about the columns that are in action menu that are not selected.

Unknown Speaker  23:18  
So effective locations high yield IDs is high on the list holdings type and former holdings it these statistical code with the statistical code how they should be separate because this is a multiple entry field. How how they should be listed following by commas our new line

Unknown Speaker  23:55  
it looks like for notes, they're using pipes. So that's probably fine for that two

Unknown Speaker  23:59  
pipes. And the column number we actually covered, we have I have also a response suggesting staff suppress there is no steps of that step suppose on the holding circuit, so I do believe the user or the respondent meant an item by instance level and this will be again drilling down to the housings record that will be covered by the by the Guerra electronic access as I mentioned, this worries me the rendering of it. Is that your URL only valid or you need the type of electronic access as well.

Unknown Speaker  25:05  
So I mean, I think that our use case would be, we would want to see everything but the URL because the URL is unique. And when we're doing, and maybe the CSV is enough for this, but we're frequently like, we put our platform names as the link text. And, you know, we're frequently like normalizing the material specified statements. So for us, it would really be, you know, materials, specified statements, link tags, the notes, and the type, right, we would want to correct, like somebody entered everything as version of the resource, and it is actually needs to be the

Unknown Speaker  25:53  
resource. And I understand this part that this, you'll may want to change that in Alana, who will only support changes to be located holdings location, temporary and permanent locations. The other fields will come later. But do you want to see this information rendered in column on the preview screen?

Unknown Speaker  26:25  
I don't remember if we asked for this or not in the survey. But I don't know that this is a high price already. For us. I do know that we have a use case for changing that, which is why I spoke up.

Unknown Speaker  26:41  
And I understand that this will be down the road to the fields that will be supported in the in approach for Holdings Record edits, but I'm not sure we need to display this data in the columns. Sure.

Unknown Speaker  27:04  
Remind me is the holdings type maybe likely did?

Unknown Speaker  27:14  
Too much? Is this good to read now, if this,

Unknown Speaker  27:22  
if this is just about the confirmation screen, and I do find that I think it was Lido who earlier said that it would be worthwhile having just kind of something is present or not present just to have that added knowledge that you don't got the ebook rather than the print book or you have to rent. And otherwise, I don't think we in the confirmation screen again, that all this detail needs to be there in the CSV, it does need to be there, including the URL string, which I have had to do bulk changes to our URL strings frequently. So if if the string itself gets changed, but the unique identifiers is the same, right, or they all went HTTPS, and they had all been HTTP, HTTP before, or we migrated our server for our easy proxy. And so I had to change all the easy proxy prefixes across all the holdings records. You know, there's definitely use cases for needing to change the URL in batch, but that can be in the CSV obviously.

Unknown Speaker  28:42  
There was one mention of the including associated order, your purchase, purchase, purchase lines put purchased or their lines. And the feedback on that. Ducking about this line,

Unknown Speaker  29:06  
thank you, again, that would be something more at the query level. To know, you know, that it's there. Now, I think the usefulness of the preview screen would be I'd like to be able to preview the columns that I was actually taking an action. Yeah. Thanks, think I'm starting to think about it more in in that respect, rather than as because there's so instead, you're just literally getting a preview of the first dozen or so lines. It's not, it's not good to use as a as a failsafe. But to get a preview of what your first 10 or so changes were going to look like for the L Let's since you are going to change would be useful

Transcribed by https://otter.ai

  • No labels