Books API not working? Scraper getting 403 Forbidden

[mattj256]

Hi. Thanks for creating this project!

I'm trying to execute the sample code from the README.

##!/usr/bin/python3

from storygraph_api import Book

id = "e5a59ed0-31f0-46af-849e-cd8e624b68ff"
book = Book()
result = book.book_info(id)
print(result)

The final Python error message:

"{\n "error": "Parsing Error: 'NoneType' object has no attribute 'contents'"\n}"

This isn't very useful so I debugged with my IDE:

Looks like BookScraper is getting 403 Forbidden from TheStoryGraph.

I see the same 403 error from curl.
(Note: the README has book ID fbdd6b7c-f512-47f2-aa94-d8bf0d5f5175, which gives the same error.)

$ curl -o - -I https://app.thestorygraph.com/books/e5a59ed0-31f0-46af-849e-cd8e624b68ff
HTTP/2 403 
// ...

It looks like the request is getting rejected by CloudFlare, before it gets to TheStoryGraph.

Am I doing something wrong here? Is this something that worked a few months ago, and now it doesn't work? Any help/advice would be appreciated. Thanks.

[kirst412]

Hey @mattj256 did you ever get a resolution to this? I'm running into the same issue on my end with the book parser? Don't have any issues currently with the user parser.

[mattj256]

Hi @kirst412
No, I never found a resolution.
(I was working on a personal project, and after I hit this issue I realized the personal project wasn't very important to me 😄 )

Based on the information that's publicly available I assume that first everything was working fine in this repo, and then afterwards TheStoryGraph added CloudFlare to the Books API to prevent bot traffic from having access.

I see the User API requires a cookie and the Books API does not. Maybe try sending the cookie with the Books API and see if that works? (Sorry I don't have time to investigate.)