Developing the Reading Log - internetarchive/openlibrary GitHub Wiki
This is a tutorial on contributing to the "My Books" experience and developing the Reading Log.
For information on using the My Books Dropper, go here.
When a patron clicks on their My Book main navigation button, they're brought to the url /account/books and shown My Books overview that provides a summary of their loans, lists, reading log, and more:

The html template that renders the My Books experiences is called books.html. This base template is used to render a variety of different my books pages consists of a left sidebar menu that looks like this:

The books.html template also contains rules for deciding what primary content and sub-templates will be rendered to the right-side of the menu, e.g.:

The main books.html base template is used to render the patron's...
- My Books Overview page (shown above)
- Loans page
- Reading Log pages -- example
- Lists overview page
- Individual List pages
-
- Loan History page (in development but will look similar to the Reading Log pages
As explained in the Patron's Experience section above, when a patron clicks on their My Books button, they will be brought to /account/books which will then redirect to /people/{openlibrary_username}/books. The routers that handles these redirects is defined in https://github.com/internetarchive/openlibrary/blob/35d6b72c7851f260d673fbcd9ce3f95b0e9c3169/openlibrary/plugins/upstream/account.py#L792-L811. These redirects route to another set of routes defined in the mybooks.py plugin: https://github.com/internetarchive/openlibrary/blob/master/openlibrary/plugins/upstream/mybooks.py#L23-L44. These routers essentially look for any url pattern of the form /people/{openlibrary_username}/{path} and uses a controller in the same file, a class called MyBooksTemplate (defined on https://github.com/internetarchive/openlibrary/blob/35d6b72c7851f260d673fbcd9ce3f95b0e9c3169/openlibrary/plugins/upstream/mybooks.py#L184-L368) to render the appropriate my books view (such as overview, loans, loan history, reading log, lists, an individual list, etc).
Depending on the {path} specified within the url, different models may be used to prepare and fetch data and different sub-templates will ultimately be within the books.html base template. Within the MyBooksTemplate, a variable named key is used to make determinations based on the {path} about what data to fetch and what sub-templates to render .
- Patron types in the url
/account/booksafter logging in, which is matched by the route inplugins/account.py - Patron is redirected to
/people/{their_openlibrary_username}/bookswhich is matched by themy_books_homeormy_books_viewroutes inplugins/mybook.pyon https://github.com/internetarchive/openlibrary/blob/master/openlibrary/plugins/upstream/mybooks.py#L23 - The router calls the
MyBooksTemplatecontroller with a key ofmybooks(instructing it to fetch the corresponding data for, and to render, themybooksview): https://github.com/internetarchive/openlibrary/blob/master/openlibrary/plugins/upstream/mybooks.py#L184 - In the preamble / initialization of the
MyBooksTemplatecontroller, shared data will be fetched that is required by every view to generate the left sidebar menu (such as the logged in patron, the names of their lists, reading log counts): https://github.com/internetarchive/openlibrary/blob/master/openlibrary/plugins/upstream/mybooks.py#L202-L237 - Next, different
ifstatements and control structures are hit to determine which data we should load and send totemplates/books.htmlbased on thekeyderived from the url pattern (e.g.mybooks,lists,loan_history, etc). - In this example, we determine based on the url we're on and the
keyvalue specified, that the LoggedBooksData model should be used to fetch the book data we need to render our view: https://github.com/internetarchive/openlibrary/blob/35d6b72c7851f260d673fbcd9ce3f95b0e9c3169/openlibrary/plugins/upstream/mybooks.py#L254-L270 - Eventually, when all the appropriate data is collected, it will be passed into the books.html base template: https://github.com/internetarchive/openlibrary/blob/35d6b72c7851f260d673fbcd9ce3f95b0e9c3169/openlibrary/plugins/upstream/mybooks.py#L288-L303
- In
books.html, logic is defined that dynamically determines what the title of the web page should be (https://github.com/internetarchive/openlibrary/blob/35d6b72c7851f260d673fbcd9ce3f95b0e9c3169/openlibrary/templates/account/books.html#L27-L54), renders the left sidebar (https://github.com/internetarchive/openlibrary/blob/master/openlibrary/templates/account/books.html#L74) and then renders the correct child template for this view: https://github.com/internetarchive/openlibrary/blob/master/openlibrary/templates/account/books.html#L154-L173
- A new router defining your desired url pattern needs to be defined in
plugins/mybooks.html, such as is done bymy_books_view. This router should make a call toMyBooksTemplate().render() -
MyBooksTemplateshould be updated so there is an additional check within theif/elifcontrol flow for the newkeyor page you wish to add. This section should fetch the books or data which will be required by the view. - You'll want to update
templates/book.html(the base template for all ofMy Booksviews) so that it defines what the title should be and what templates should be rendered when your url pattern /keyis encountered. - You may then have to create a new template within
templates/account/that renders the data in a suitable way. In many cases, we'll want to refer to theaccount/reading_log.htmltemplate as the basis for our design: https://github.com/internetarchive/openlibrary/blob/master/openlibrary/templates/account/reading_log.html
For a complete, minimal example of adding a new page or view to the My Books system, please refer to PR #8375 as well as this comment which describes how data specific to a new loan_history page may be prepared that is suitable to be passed through the account/books.html base template.
NOTE: This section is now outdated as much of the routing and controller logic has been moved out of plugins/upstream/account.py and in to plugins/upstream/mybooks.py, into the MyBooksTemplate. Still, this section is useful to see how we went about extending the functionality of the Reading Log page to add the ability to search for books on your currently reading, want to read, and already reading shelves.
In #5080, you can read through a slightly unrealistic example of adding Search filtering capabilities to the Reading Log:
By unrealistic, we mean that this proposal currently will not work as implemented because book titles, authors, and the other data we'd like to search for are not kept in our ReadingLog db table, only the OL identifiers. We may be able to achieve this with solr in the future. But assuming we did have the desired info in our database (and as a thought exercise):
- First, we'd need to update the Reading Log html template (https://github.com/internetarchive/openlibrary/blob/master/openlibrary/templates/account/books.html) to include a search box (design task). For a first version, we'd probably use an html form which submits a GET search query , similar to what we have on the author's page: https://openlibrary.org/authors/OL7283091A
. In the future, we might want to use javascript (similar to how we the real-time Search box works at the top of the website):
- Next, we'd need to update the
public_my_bookscontroller method in https://github.com/internetarchive/openlibrary/blob/master/openlibrary/plugins/upstream/account.py#L733-L760 to accept a GET parameter. Already, the function expects apagevariable to be sent as a GET parameters (https://github.com/internetarchive/openlibrary/blob/master/openlibrary/plugins/upstream/account.py#L738) so accomplishing this should be as straightforward as adding another parameters like,i = web.input(page=1, search=None). - When/where we fetch the patron's books here: https://github.com/internetarchive/openlibrary/blob/master/openlibrary/plugins/upstream/account.py#L754, we need to alter the logic to check whether a
i.searchquery is present (e.g.if i.search). If thei.searchvalue is present, we'll need change the linereadlog.get_workscall so this optionalsearchparameter is passed along with our request for matching books. -
readlogis an instance ofplugins.upstream.account.ReadingLog(class defined here: https://github.com/internetarchive/openlibrary/blob/1f57759886b65430d805270830677120c1dc067d/openlibrary/plugins/upstream/account.py#L645). Itsget_worksmethod (https://github.com/internetarchive/openlibrary/blob/1f57759886b65430d805270830677120c1dc067d/openlibrary/plugins/upstream/account.py#L716) will need to be updated to accept an optionalsearchparameter (e.g.(key, page=1, limit=RESULTS_PER_PAGE, search=None)). ThisReadingLog.get_worksfunction essentially uses aKEYSdictionary (defined here: https://github.com/internetarchive/openlibrary/blob/1f57759886b65430d805270830677120c1dc067d/openlibrary/plugins/upstream/account.py#L654-L660) to lookup and then invoke the proper book-fetching function. - Each of the corresponding
ReadingLogmethods referenced by theKEYSdictionary (namely:get_waitlisted_editions,get_loans,get_want_to_read,get_currently_reading,get_already_read) must thus also be updated to take an optionalsearchparameter. Each of these functions ultimately makes an API call to the same function within ourBookshelvesAPI model:Bookshelves.get_users_logged_books(https://github.com/internetarchive/openlibrary/blob/master/openlibrary/core/bookshelves.py#L118-L149) - After a search box form has been added to the
template, thepublic_my_booksview/controller has been edited to expect asearchparameter, thissearchparameter is forwarded to ourreadlog.get_workscall, and thereadlogobject (i.e. theReadingLogclass) have all been updated to accept an optionalsearchparameter, we'll then need to do the hard work of modifying the actual APIBookshelves.get_users_logged_books(the thing which calls the database) to consider the possibility of an optional search parameter when requesting data from the database: https://github.com/internetarchive/openlibrary/blob/master/openlibrary/core/bookshelves.py#L118-L149).
The same example above (which pretends to add Search filtering to the Reading Log) can be adapted to add an option to sort one's Reading Log entries by date added, such as is requested in Issue #4267.



