BiblioShare analytics showcase growing records and usage
•Download as PPTX, PDF•
0 likes•276 views
The document summarizes statistics about records in the BiblioShare database. It shows that the database grows by approximately 0.05% daily, with over 3 million total records as of 2019. The records include ONIX data, cover images, interior images, and author images. The document also analyzes usage of the Thema subject classification scheme within BiblioShare records and top subjects. It provides statistics on the usage of various Thema codes for subjects, geographical qualifiers, and additional subjects.
Recommended
Recommended
More Related Content
More from BookNet Canada
More from BookNet Canada (20)
Recently uploaded
Recently uploaded (20)
BiblioShare analytics showcase growing records and usage
- 1. BiblioShare A day in the Life
- 2. 2018 Average New Records/day : 3,014 Average Updated : 103,232 2017 Average New Records/day: 1,836 Average Updated : 101,556
- 3. Average new Records: 1,334 Average updated Records: 111,861 Average New Records: 1,611 Average Updated Records: 139,650
- 4. BiblioShare 3 million records and counting
- 5. 4.5% of records updated daily
- 6. dataset currently growing at approximately .05% daily or 588,015 new records in 2019
- 7. Total ONIX 3.0 Records 268,232
- 11. Samples : 359 Reader Guides : 157 Table of Contents : 19
- 12. Canadian Content
- 13. ONIX 2.1 • 123,000 Canadian ‘Authored’ Works ONIX 3.0 • 16,568 | 6.17% of total Contributor Code = CA
- 14. Thema unified subject classification scheme for the global book trade – physical & digital
- 15. Use following values from codelists 26 & 27 • 93 Thema subject category • 94 Thema geographical qualifier • 95 Thema language qualifier • 96 Thema time period qualifier • 97 Thema educational purpose qualifier • 98 Thema interest age / special interest qualifier • 99 Thema style qualifier THEMA IN ONIX
- 16. 2018 180 unique users 3244 conversions We have a BISAC to THEMA converter bisactothema.biblioshare.org/Importing.aspx
- 17. CODE HeadingText # of isbns Percent of all LNB Private or civil law: general 2509 1.48 N History & Archaeology 2570 1.51 QRVC Criticism & exegesis of sacred texts 2671 1.57 QRMF1 Bibles 2805 1.65 DSBH Literary studies: c 1900 to c 2000 2876 1.69 FW Religious & spiritual fiction 3011 1.77 QRVX Personal religious testimony & popular inspirational works 3282 1.93 DSB Literary studies: general 4842 2.85 QRM Christianity 5517 3.24 QRMP Christian life & practice 8630 5.07 THEMA 93 Top 10 BiblioShare MAINSubject Total 22.76% of all Thema subject codes currently in use in MainSubject
- 18. CODE HeadingText # of isbns Percent of all GTM Regional studies 2681 1.02 QRM Christianity 2785 1.02 DS Literature: history & criticism 2840 1.08 GTC Communication studies 2882 1.09 QD Philosophy 2971 1.13 NHD European history 2992 1.13 NHTB Social & cultural history 3392 1.28 DSB Literary studies: general 4005 1.52 JPA Political science & theory 4272 1.62 YFB Children’s / Teenage fiction: General fiction 4394 1.66 THEMA 93 Top 10 BiblioShare Total 12.6% of all Thema subject codes currently in use in additional subjects
- 19. THEMA NHAH – Historiography KCG - Economic Growth NHK - History of the Americas KCM - Development economics & emerging economies KCVD - Agricultural economics KCK - Behavioural economics NHQ - History of specific lands KCF - Labour / income economics JPF - Political ideologies JPA - Political science & theory NHTV - Revolutions, uprisings, rebellions KCA - Economic theory & philosophy KJSM - Market Research KNA - Agribusiness & primary industries NHTB - Social & cultural history JPH - Political structure & processes LND - Constitutional & administrative law: general NHTD - Oral History KJV - Ownership & organization of enterprises KCD - Economics of industrial organization JPB - Comparative politics Les expériences corporatives dans l'aire latine 9783039117499
- 20. CODE HeadingText # of isbns Percent of all 1KBB-US-W US West 69 1.68 1DT Eastern Europe 71 1.73 1DSE Spain 93 2.27 1DSP Portugal 93 2.27 1FMV Vietnam 99 2.42 1KBC Canada 228 5.57 1DDU United Kingdom, Great Britain 279 6.81 1D Europe 291 7.10 1FB Middle East 366 8.93 1KBB United States of America, USA 1230 30.02 THEMA 94 Top 10 BiblioShare Total 68.81% of all Thema Geographical Qualifiers currently in use in MAINsubject
- 21. THEMA 94 Top 10 CODE HeadingText # of isbns Percent of all 1DDU-GB-ES South & South East England 546 1.89 1QBA Ancient World 625 2.17 1DT Eastern Europe 693 2.40 1KB North America (USA & Canada) 763 2.65 1DDF France 1018 3.53 1D Europe 1106 3.84 1KBB United States of America, USA 1198 4.16 1DDU United Kingdom, Great Britain 1844 6.40 1KBC Canada 2769 9.61 1DFG Germany 4821 16.73 BiblioShare Total 53.37% of all Thema Geographical Qualifiers currently in use in additional subject
- 22. BISAC Regional
- 25. • Full Thema support! • Automagically create your Thema subject from your main BISAC subject. • Ability to add more than one subject. • Added support for Country of Manufacture
- 27. Over 64,378,685 Requests Served BiblioShare Web Services
- 28. • BiblioSimple 7,630,142 • ONIX 6,582,612 BiblioShare Web Services
- 29. Full image 3,864,373 Thumbnail 2,835,918 Image info 42,808,158 BiblioShare Web Services
- 30. 69,524 Release Calendar BiblioShare Web Services
- 31. Sales Agency Vendor Management Retailers Library Wholesaler Publishers
- 32. Supporting legacy Wordpress plugin: Just Worked!
- 38. The Team
- 39. Cheerleader
- 40. “National Treasure” “Domain Expert” “The Guru” Final thought: All text is already encoded in some encoding.
- 41. The Developer
- 43. And a cast of geeks
Editor's Notes
- Good Afternoon – hope you’re all having a great, informative day at Tech Forum this year. While we are all here soaking in all of this great information our BiblioShare platform is working away diligently without rest. I have been elected by BiblioShare to come here today and speak to you about what it does. My name is Tim Middleton and I am one of the on-call babysitters of BiblioShare. So lets get to it! The heart of BiblioShare is about ingesting ONIX metadata. Yes we do give back Quality reports to the providers of the data and yes we do let them see the history of files being sent, let them search their products in BiblioShare, merge their publisher’s records with their supplier’s records when and where it is possible, we can lock their data, exclude their data and a few other things - but at the heart of BiblioShare is ingestion.
- In 2018 BiblioShare received on average each day 3,014: New Records 103,232: updated Records: Which is up slightly compared to 2017 where we saw on average 1,836 New records added each day and 101,556 updated each day Because every day is different not to mention every year, and because our recruitment efforts are ongoing - in fact we have been putting quite a bit of effort into going after more international data - I wanted you to see what the year-to-date looked like in comparison to 2018.
- In 2018 from January to March we have ingested: an Average of 1,334 New Records: and an Average of 111,861 updated Records: In 2019 from January to March we have ingested: an average of 1,611 New Records - a 17% increase over 2018 and an Average of 139,650 updated Records: or a 20% increase over 2018 #Looking deeper into the heart of BiblioShare
- 3 million ONIX 2.1 records
- That means on average (if my math is right – don’t check!) we are seeing 4.5% percent of records getting updated daily and
- The data set is currently growing at a rate of approximately .05% daily with new records. Of course this is only a forecast - we have no idea how many new accounts we may get in 2019 or how big those accounts will be – #And as many of you hopefully know
- There is a “new” version of ONIX out there which we are also ingesting. We have a and whopping 268,232 records – most of which are coming from Canadian Owned publishers. But BiblioShare is not so much one heart as it is many hearts beating together. The graphs I showed earlier represent only 2.1 ONIX data coming in - merely only one ventricle of the heart - BiblioShare also accepts #all sorts of images
- Including over 2million cover images #
- 170 thousand interior images #
- And over 4000 thousand author images. We are also still trying to ramp #up on Samples
- Samples, Table of contents and reader guides all of which will soon be used in BNC CataList and Loanstars. We definitely have a ways to go here but there are more and more use cases emerging that require this data and so – well if you have it send it!
- BiblioShares heart of hearts is really very Canadian. We are driven to help the discovery of Canadian content And looking into the heart of BiblioShare with our Canadian flag glasses on #we see
- Publishers who have added CA when the author is Canadian. This is so helpful when we are asked about Canadian content. We can and have created files that are used to populate sites that are only looking for Canadian titles. And we can add things like our lovely Canadian Flag in products that we create. You can see how in our ONIX 3.0 dataset there is an obvious slant toward Canadian publishers since you can assume most Canadian authored titles are coming from Canadian owned publishers. At least I assume that. But is it enough? Canada is a big place, not every author identifies as Canadian so we can look into other places to uncover Canada #one area we can look into is the new global classification system
- Thema. Thema is an international classification system that is used mainly outside of North America which uses the BISAC classification system. Thema is meant to help reduce the need to map multiple national and specialist schemes to one another when trading with international partners. # .
- Thema is not meant to replace BISAC right away but eventually, perhaps? If you want to convert your BISACs to thema #we have you covered with
- Our BISAC to Thema converter which was fairly well-used in 2018 By 180 unique users and 3244 conversions we took a look at the population of Thema in BiblioShare and found #that the top ten Thema categories
- Represented almost 23% of all records with Thema In the MainSubject field in ONIX - it appears the Christians are on a crusade to use Thema with “Christian Life and Practices” coming in 1st and then Christianity in 2nd #when we checked in on additional subjects
- The top ten here represented 12. 6% of all records with a Thema subject: this time Christianity is way back in 8th place while “Children’s / Teenage fiction: General fiction” snuck ahead of “Political science & theory” for 1st place. #the book with most thema subjects in BiblioShare
- Is this French title by Peter Lang AG, Internationaler Verlag der Wissenschaften (not a very French sounding name) being submitted to BiblioShare by their Canadian distributor. That is a lot different areas that one might shelve this book in their store but if the Thema fits apply it! Not sure that is actually a best practice but it sounds good. Code value 94 in Thema is the geographical qualifier so this is where we can start to uncover more Canadian content #so again
- Again we looked at the top ten geographical qualifiers populating the MAINsubject (not likely a good spot for it but I digress) The top ten represents 69% of all Thema “geo tags” – in the MAINsubject – that basically means not a lot of providers are placing this qualifier in the MAINsubject. #looking at additional subjects
- Still a pretty high percentage is represented by these top ten – 53.37% - but look Canada came in 2nd place, that is like a silver medal in some situations! Another classification system that is still relevant for #discovering Canada are
- The Bisac Regional codes. A regional theme is intended to refer to the book's content and should be used to highlight a book for: Appropriate sales representatives; Regional purchase by booksellers and chain buyers; Cataloging considerations and regional librarians; Regional promotions and media. But you likely already knew that. - I hope this data gives you a little bit of an idea about how Canada is represented in BiblioShare. -but what if you don’t have ONIX data and you want to have it so you can add to Canada? #there’s software for that
- BiblioShare Webform is for small presses, unconventional publishers, museums, universities, self-published authors… in short, anyone who wants to provide clean, accurate metadata about their books to the supply chain through BiblioShare, but doesn’t have the resources to create complex ONIX files from scratch. #Currently in Webform we have Pricing Annual pricing is based on the number of title records (ISBNs) your organization creates or maintains using the Webform. We offer a 25% discount for publishers who are also subscribed to CataList. Annual Price $50 $150 $175 $200 $375 Record Limit 10 50 100 200 500
- 50 accounts for a total 2767 I say in BiblioShare – but the truth is just because you use Webform to create your ONIX doesn’t mean you have to load it to BiblioShare. Why you wouldn’t I don’t know, but the point is you don’t have to, only if you want to have your titles added to a CataList catalogue or picked up by 49th , or discoverable by bloggers, retailers and more do you need to send it to BiblioShare – but hey, it’s up to you.
- in 2018 we made a few tweaks: Full Thema support! (yeah! – go get discovered) Automagically create your Thema subject from your main BISAC subject. (a built in bisac2thema converter!) Ability to add more than one subject. (this was limited to one Main Subject previously) Added support for Country of Manufacture (very important –ask Tom Richardson!)
- If ingestion is the heart of BiblioShare (remember that metaphor?) then certainly the mind of BiblioShare is thinking about the possibilities of all that data. That is when we start to look at where all of the data is going. We have webservices that provide a complete ONIX record, an ONIX light record (BiblioSimple), Image service and we have also created a MARC record output that maps an ONIX record to MARC so libraries can have a stub record to start to build their full MARC record. #in 2018
- we had over 64 million requests for data in BiblioShare #there were over
- 7million BiblioSimple requests and 6 and half million FULL ONIX requests. #Not too shabby
- We had users make 3.9 million Full image requests, 3million thumbnail requests and almost 43 million requests which were just asking about images like do we have them, when were they updated last, what is their format, perspective, dimensions - all good questions to ask before just taking. #and even
- #our beta release calendar has seen a lot of action with close to 70,000 requests coming in.
- All of that data can help to solve critical conditions for other users as well and as we’ve discovered over the years not everyone wants the same output. A lot organizations out there don’t want ONIX but they do want what is in ONIX. This year we created solutions for Sales Agencies, Vendor Management companies, non-traditional and traditional Retailers, Library Wholesalers, and Publishers. And lets not forget the consumer, the blogger, the reviewers, the media and more. That world knows nothing of ONIX but wants to know what ONIX knows, and so the brain of BiblioShare is able to provide solutions for all of those. Which brings me to one final story that I would like to share. #It is about
- Supporting Legacy! It is hard to believe that Wordpress is considered old now but in the ancient digital past with long gone staff and fresh ambitions we built a plugin that hooked into BiblioShare. This used our BiblioSimple webservice and had some good uptake.
- After years of just working with minor tweaks here and there, we started to notice things were not “just working” anymore - not to mention Wordpress announced Gutenberg would be the new default editor for Wordpress.
- We had to shift some time and resources over to looking into Wordpress. That is on par to revving up an old engine after it has sat for a couple of years. We fixed some PHP errors but that wasn’t enough. The plugin didn’t work in the Gutenberg editor. People had to flip to classic and that was a hassle. Most modern themes don’t use classic mode. If there is a problem with a plugin and theme developers see a plugin hasn’t been worked on for a bit right away the plugin gets blamed. And this is right. But frustrating. We had to make a decision: do we build the support for the block editor or do we just call it quits on supporting the plugin? We could build it but it would take away from our core focus on other projects.
- We tried an experiment on upwork? The potential here was so exciting. We could just post on upwork and get quotes for the job and done. It was a good experience. But we didn’t find the developer we were looking for there, but we did find a wordpress development services house through another channel.
- Our experience with this company was excellent and for us a great example of how the development world has changed lock step with the shared economy.
- The final point is that we got what we wanted in lightning speed. Cost was reasonable and now we can just let the plugin work for another 7 years - fingers crossed!
- So in wrapping up this year in BiblioShare (even though there is oh so much more to tell) I hope you understand that we wouldn’t be anywhere if we didn’t have a bunch of people at BookNet and in the industry who are interested in the intricacies of metadata. We are a tribe. #I include myself in there because I get to be a
- project manager on the BiblioShare Team. I get to dip in and out of metadata and admire its possibilities. I get to see it going through from the beginning to the end I get to see the making of the sausage. And of course along with a tribe interested in metadata is the #tribes guru
- and in our case that is our Bibliographic Standards manager, Tom Richardson. Tom in his natural habitat is a mild mannered ONIX expert. This has made Tom over the years a much sought after resource for helping publishers get their act together. And as much as he hates BiblioShare, he also loves BiblioShare
- Next, we wouldn't get far without programmers who’ve earned their stripes in ONIX land by supporting numerous BookNet platforms with ONIX data. This is Tom Gerrard, our calm calm hand on the BiblioShare Dev wheel.
- our Director of Product Development, keeps us honest. She asks questions. She dreams of integrations and making things easier, auditable, traceable. Without her things fall into the crapper. And our Director of Product Development, Jackie Fry is all that and more.
- There is also a host of other people at BookNet who have a passion for geeky things like the keywords for Canada, Romantic Love, or the best way to tell a machine where you’re from, about the region you live in and more. This is the Team – the soul of BiblioShare. If you see them here today give them a thanks for their geekiness – likely you won’t recognize them though because there in their secret identities of book loving nerds just like you. Thanks.