site banner
ArjinFerman  Tinfoil Gigachad  3d ago (text post)   462 thread views

Tinker Tuesday for February 25, 2025

This thread is for anyone working on personal projects to share their progress, and hold themselves somewhat accountable to a group of peers.

Post your project, your progress from last week, and what you hope to accomplish this week.

If you want to be pinged with a reminder asking about your project, let me know, and I'll harass you each week until you cancel the service

1
Top Bottom Old Controversial Comments
Jump in the discussion.

No email address required.

So I was looking into strapping a crawler on my Nitter / Miniflux solution, and decided to take a stab an rewriting the damn thing from scratch.

Don't get me wrong I do like how it works, but the more I thought of crawling and archiving websites with it, the worse of an idea it seemed.

  • First, as nice as Miniflux is, it's structure doesn't seem to be particularly friendly to strapping stuff onto it. I already had issues with the relatively small stuff I added like downloading media and running OCR on them.
  • It's all a bit too bespoke, I don't like the idea of having to run 2 independent applications to browse Twitter (+Substack and maybe Youtube).
  • I like the the chronological feed I get, but when someone puts out a banger and everyone starts retweeting it, I have to see the same damn thing 20 times (sometimes in a row). Not easily fixable in an RSS reader, but I can deal with it if I start from scratch.
  • Being able to tell that many people are referring to the same content (via retweets or link) might let me come up with some sort of Hottest Stuff Feed.
  • Sometimes the true bangers are buried in the replies, and come from people I don't follow. I'd like the ability to save their content as well, without necessarily following them.

So I've been going through Nitter and figured out how it does authenication and API requests. I'm able to fetch the latest tweets from a user, and now I'm writing an import job and trying to come up with a structure that will take care of all of the above into account. Nothing much to show off yet, but making good progress.

P.S.: This might be old news, but I recall us discussing the official announcement that Nitter is dead, but don't recall anything about it coming back to life. From the ativitiy on github and the site being up and functioning, it seems like it may have come back to life.

What is this place?

This website is a place for people who want to move past shady thinking and test their ideas in a court of people who don't all share the same biases. Our goal is to optimize for light, not heat; this is a group effort, and all commentators are asked to do their part.

The weekly Culture War threads host the most controversial topics and are the most visible aspect of The Motte. However, many other topics are appropriate here. We encourage people to post anything related to science, politics, or philosophy; if in doubt, post!

Check out The Vault for an archive of old quality posts. You are encouraged to crosspost these elsewhere.


Why are you called The Motte?

A motte is a stone keep on a raised earthwork common in early medieval fortifications. More pertinently, it's an element in a rhetorical move called a "Motte-and-Bailey", originally identified by philosopher Nicholas Shackel. It describes the tendency in discourse for people to move from a controversial but high value claim to a defensible but less exciting one upon any resistance to the former. He likens this to the medieval fortification, where a desirable land (the bailey) is abandoned when in danger for the more easily defended motte. In Shackel's words, "The Motte represents the defensible but undesired propositions to which one retreats when hard pressed."

On The Motte, always attempt to remain inside your defensible territory, even if you are not being pressed.


New post guidelines

If you're posting something that isn't related to the culture war, we encourage you to post a thread for it. A submission statement is highly appreciated, but isn't necessary for text posts or links to largely-text posts such as blogs or news articles; if we're unsure of the value of your post, we might remove it until you add a submission statement. A submission statement is required for non-text sources (videos, podcasts, images).

Culture war posts go in the culture war thread; all links must either include a submission statement or significant commentary. Bare links without those will be removed.

If in doubt, please post it!


Rules


Recommended Posts And Communities

Recommended Realtime Chats