COVID research made generic sequencing for viruses and bacteria incredibly cheap. You can run a PCR test for most things now for $10 (USD) or less. This opens a whole world of highly specific diagnostics and cheap, hyper-personalized treatments.

Also, MRNA vaccines are being tested for several other diseases and it seems very promising.

and my point was explaining that that work has likely been done because the paper I linked was 20 years old and they talk about the deep connection between “similarity” and “compresses well”. I bet if you read the paper, you’d see exactly why I chose to share it-- particularly the equations that define NID and NCD.

The difference between “seeing how well similar images compress” and figuring out “which of these images are similar” is the quantized, classficiation step which is trivial compared to doing the distance comparison across all samples with all other samples. My point was that this distance measure (using compressors to measure similarity) has been published for at least 20 years and that you should probably google “normalized compression distance” before spending any time implementing stuff, since it’s very much been done before.

I think there’s probably a difference between an intro to computer science course and the PhD level papers that discuss the ability of machines to learn and decide, but my experience in this is limited to my PhD in the topic.

And, no, textbooks are often not peer reviewed in the same way and generally written by graduate students. They have mistakes in them all the time. Or grand statements taken out of context. Or are simplified explanations because introducing the nuances of PAC-learnability to somebody who doesn’t understand a “for” loop is probably not very productive.

I came here to share some interesting material from my PhD research topic and you’re calling me an asshole. It sounds like you did not have a wonderful day and I’m sorry for that.

Did you try learning about how computers learn things and make decisions? It’s pretty neat

You seem very upset, so I hate to inform you that neither one of those are peer reviewed sources and that they are simplifying things.

“Learning” is definitely something a machine can do and then they can use that experience to coordinate actions based on data that is inaccesible to the programmer. If that’s not “making a decision”, then we aren’t speaking the same language. Call it what you want and argue with the entire published field or AI, I guess. That’s certainly an option, but generally I find it useful for words to mean things without getting too pedantic.

Yeah. I understand. But first you have to cluster your images so you know which ones are similar and can then do the deduplication. This would be a powerful way to do that. It’s just expensive compared to other clustering algorithms.

My point in linking the paper is that “the probe” you suggested is a 20 year old metric that is well understood. Using normalized compression distance as a measure of Kolmogorov Complexity is what the linked paper is about. You don’t need to spend time showing similar images will compress more than dissimilar ones. The compression length is itself a measure of similarity.

Yeah. That’s what an MP4 does, but I was just saying that first you have to figure out which images are “close enough” to encode this way.

Then it should be easy to find peer reviewed sources that support that claim.

I found it incredibly easy to find countless articles suggesting that your Boolean is false. Weird hill to die on. Have a good day.

https://scholar.google.com/scholar?hl=en&as_sdt=0%2C5&q=computer+decision+fairness&oq=computer+decison

Agree to disagree. Something makes a decision about how to classify the images and it’s certainly not the person writing 10 lines of code. I’d be interested in having a good faith discussion, but repeating a personal opinion isn’t really that. I suspect this is more of a metaphysics argument than anything and I don’t really care to spend more time on it.

I hope you have a wonderful day, even if we disagree.

computers make decisions all the time. For example, how to route my packets from my instance to your instance. Classification functions are well understood in computer science in general, and, while stochastic, can be constructed to be arbitrarily precise.

https://en.wikipedia.org/wiki/Probably_approximately_correct_learning?wprov=sfla1

Human facial detection has been at 99% accuracy since the 90s and OPs task I’d likely a lot easier since we can exploit time and location proximity data and know in advance that 10 pictures taken of Alice or Bob at one single party are probably a lot less variant than 10 pictures taken in different contexts over many years.

What OP is asking to do isn’t at all impossible-- I’m just not sure you’ll save any money on power and GPU time compared to buying another HDD.

Definitely PhD.

It’s very much an ongoing and under explored area of the field.

One of the biggest machine learning conferences is actually hosting a workshop on the relationship between compression and machine learning (because it’s very deep). https://neurips.cc/virtual/2024/workshop/84753

Compressed length is already known to be a powerful metric for classification tasks, but requires polynomial time to do the classification. As much as I hate to admit it, you’re better off using a neural network because they work in linear time, or figuring out how to apply the kernel trick to the metric outlined in this paper.

a formal paper on using compression length as a measure of similarity: https://arxiv.org/pdf/cs/0111054

a blog post on this topic, applied to image classification:

https://jakobs.dev/solving-mnist-with-gzip/

By no means the best option, but the tikz latex package works and pandoc can handle the conversion to your preferred format. I would limit this to very simple diagrams.

There’s a python application for managing the meta data better than lidarr called beets. You need to be familiar with a terminal, but it has a ton of plugins and options. If you want a GUI, try MusicBrainz Picard, but it’s old and not great on really big libraries. For playlist suggestions, plexamp can do that, but only for music you already have.

https://beets.io/

But there were giant ants during the Eocene

https://en.wikipedia.org/wiki/Titanomyrma

For the sake of argument, let’s assume a hyper-rich oxygen environment.

yes. The book, “The red badge of Courage” was printed in 1895 and the color’s association with the far left dates back to the french revolution of the 1780s.

Also, iirc Blair Mountain was backed by the IWW which is anarcho-syndicalist and not Communist.

I dunno why the downvotes but I googled it for you:

iww Blair mountain flyer:

https://omekas.lib.wvu.edu/home/s/minersorganization/media/1109

who are the iww? https://en.wikipedia.org/wiki/Industrial_Workers_of_the_World?wprov=sfla1

history of red for left wing politics: https://en.m.wikipedia.org/wiki/Red_flag_(politics)

when the black flag diverged front he red flag. https://en.m.wikipedia.org/wiki/Anarchist_symbolism

red AND black symbolism associated with the IWW https://www.iww.org/how-we-organize/

red and black flag https://en.m.wikipedia.org/wiki/File:Anarchist_flag.svg

Previously I had mistakenly said that the red flag dated back to the 1880s and the Paris commune. No, that’s the black flag as this article states. That split is actually kinda a big deal. The IWW and red/black symbolism is about grass roots power and not some revolutionary vanguard or dictatorship by the proletariats and I think that distinction is actually kinda important.

You can see the same symbolism and terminology (redneck) used in the US today: https://en.m.wikipedia.org/wiki/Redneck_Revolt

which has far more in common with black Panthers style neighborhood defense than it does with Stalin or Lenin or Trotsky.

it’s more in line with thinkers like:

https://en.m.wikipedia.org/wiki/Peter_Kropotkin

https://en.m.wikipedia.org/wiki/Emma_Goldman

which is about building resilient communities that exist apart or in spite of capitalism. It’s not really an economic policy or ideology concerned about the existence of the state or a dictatorship of the proletariat or really even collective ownership of the means of production. You can join the IWW and work for Amazon and not be committed to a 1917 Russian style revolution. They wanted better working conditions, not a bloody coup. While I agree that that’s associated with the Marxist ideal communist ideal future post-capitalist Star Trek furture is great, I think the IWW is notably and distinctly different than what Americans in the 1920s would have associated with the word “communist”.

Absolutely not.

deleted by creator

My Lord. Type “Halliburton oil Ukraine” into Google maps and look at the god-damned oil field that’s owned by a US company. Or look at how the US has has record natural gas exports every year since 2014.

Or look up how the US weapons weren’t given to Ukraine. They were sold and those loans must be paid back. Britain and Russia didn’t pay back their WW2 lend-lease debts until 2006.

The US is making a killing on this conflict. Ukrainians are also dying for their nation, but two things can be true at the same time. Anyone who isn’t a moron can see that.

must be your client. the link works fine for me. If you see the timeline, locals mostly weren’t involved and lots of local anti fascists organized and fought back. This island was nominated for the Nobel prize when the crisis started, but there’s only so much people can take when the refugees kept coming, the island couldn’t support thousands of extra people, and refugees were forced to cut down centuries old olive trees for cooking fuel. Greece is not a wealthy country and they felt betrayed by places like Sweden and Germany that have robust economies and a much smaller proportion of the refugee crisis.

Something had to give. Moria camp is essentially an open air prison without running water or showers. Most people who arrive are children, or were before they walked to Turkey from the Congo or Afghanistan or whatever and boarded boats for a chance at a better life.

I heard stories from teenagers who had escaped slavery or been forced to work in fast fashion factories in Turkey without pay or had their passports stolen in Iran or picked up by a militia in the Syrian civil war and handed a weapon. And the EU just leaves them there. They get like €200 a month, if and when their legal case ever concludes, but that’s not enough to actually live and they’re not allowed to work. Not like Greece has extra work anyway.

Maybe the countries that make a fortune by selling arms to conflict zones (France, Germany, Sweden, Belgium, Italy) should step up and take care of the crises they manufactured for profit. But nah, they just elect far right parties because brown people are scary.