Oh my it actually posted ๐ Had some issues posting since well lots of people joined ^^"
LightNovels
This community based around translated Light Novels, Novels, and Web Novels which originate from Japan has been migrated to a new instance: https:// ani . social/c/lightnovels (remove the spaces)
I know of lndb.info (seems to have some problems at the moment) and novelupdates.com.
Personally I use MyAnimelist.com (light novels are mixed into the manga category there) to track my novels when I care to remember to do so.
Since there are only a hand full of LN publishers it might be a viable option to scrape from their websites directly.
lndb.info is basically dead at this point and does not work correctly at the moment. Novelupdates might be useful though for getting the japanese stuff.
Never used MAL myself so I can't comment.
As for scraping together the info. Yen Press and J-Novel Club went pretty fine tbh. I have their stuff already. The others ones are bit more problematic. Cross Infinite World has a site but they don't really include all the info I would have liked and scraping their site seems like quite the undertaking since scraping the correct stuff seems difficult.
Seven Seas also is missing quite some info on their site I will have to figure something out for these two.
Ultimately I would love to get the japanese stuff as well but me lacking japanese skills will make that one very difficult. Though I guess Novelupdates might prove useful here.