Indexing all posts, etc is quite a lot to handle, so I wanted to start small and just focus on video search. I've started indexing videos from Peertube and other video websites. (Even YouTube but this could be removed to just focus on independent sites)

I know Peertube has their own search engine for videos. I will be reaching out to them. Compared to my site I'm planning it'll have other video sources and be easier to use.

So that leads to feedback from you guys.

What do you think about indexing videos posted on the fediverse and other independent platforms?
Are there similar services?
Am I just wasting my time?

(page 2) 21 comments

sorted by: hot top controversial new old

[–] [email protected] 1 points 9 months ago (1 children)

I don't know anything about the technical side of this. But I would (possibly naively) think that it would be simpler to have a filter that you could automatically apply to sift bog-standard search engine results for Fediverse instances? Like adding "site:uk" to the end of a normal search, except that your filter term would check a list of Fediverse instances to return the relevant results.

And make it an app/add-on so that people can use it with their usual search strategies.

[–] [email protected] 1 points 9 months ago

People been doing that now but it comes with limitations. Thanks for the input.

[–] yuki2501 -4 points 9 months ago (1 children)

Just, for the love of god, make sure to make it opt-in. Don't scan people's posts without their consent.

Also, if you're going with this, make sure to respect people's requests for removal, e.g. deleting their posts from the engine when they delete them from their instances. Otherwise you'd get in trouble with the EU regarding GDPR...

[–] [email protected] 1 points 9 months ago

Your public posts are not protected from GDPR from indexing...

load more comments