Maybe there's a pattern here?

(dynomight.net)

138 points | by surprisetalk 2 days ago

16 comments

  • lwansbrough 2 hours ago
    Tangential, but one thing that really irks me is when people advocate for nuclear proliferation as a safety feature.

    Aside from just the potential for accidents, one has to consider the potential for irrational actors or those who choose to employ game theory more recklessly. And when I think of Metcalfe's law, I feel this sort of horror about the idea of proliferation and the loss of control in communication (which was of course vital in preventing Armageddon during the Cold War.)

    I think ultimately, future security will come from defensive technology and I believe that's the most noble pursuit for engineers wishing to leave an indelible mark on humanity.

    There is of course no defensive solution against those who wish to build Sundial [0] or Poseidon [1]. Humanity appears to be unequipped to carry the mantle of life.

    [0] https://en.wikipedia.org/wiki/Sundial_(weapon) [1] https://en.wikipedia.org/wiki/Poseidon_(unmanned_underwater_...

  • abetusk 5 hours ago
  • seydor 6 hours ago
    Yeah the pattern is , "with great power comes great irresponsibility" , which is only confained when the power is matched by rivals
    • notarobot123 2 hours ago
      Yet the Cold War taught us that competition between rivals doesn't contain power at all.
      • expedition32 58 minutes ago
        Should power be contained? Humans always rise up against their oppressors and I find that a comforting thought.

        Tyranny, slavery, colonialism- it never lasts.

        • Chris2048 46 minutes ago
          > Humans always rise up against their oppressors

          Successfully?

  • roxolotl 1 hour ago
    This is a great reminder that the line drawn by Anthropic is already too far and that if you’ve been driven to cancel your OpenAI account by their behavior you should also cancel your Anthropic account.

    The other pattern that’s a bit less explicit here is that these technologies try to win over the public by theorizing on their incredible peace time use. While many genuinely have great use in peacetime we should not allow that to blind ourselves to their wartime potential. Many of us have little power to direct the future but for those who care doing what you can do is always more than nothing and when done in concert with others does have an impact.

  • lilytweed 2 hours ago
    For any readers who liked this essay, check out Benjamin Labatut’s fantastic novel “When We Cease to Understand the World,” about scientists and mathematicians who were more or less driven mad by their discoveries. The history of modern warfare and dual use technologies is a big part of the book.
    • trevyn 2 hours ago
      Sorry, this is fiction about real-life scientists being driven mad, when in fact the real-life scientists in question were not driven mad?
  • redhanuman 6 hours ago
    Gatling died in 1903 and he never saw his gun used in a trench and the engineers at Anthropic, OpenAI, Google they're watching it happen on X in real time..that's the difference nobody's talking about So Does seeing it change anything? I genuinely don't know.
  • ineedasername 5 hours ago
    “Maybe there’s a pattern here”

    Is is that surprisingly few weapons inventors expressed regret and doubt? Or just that very few wrote about it?

    Snark aside, we have massively more people alive today than in 1900 and yet the proportion of people that die in armed conflicts is— while horrific- barely noteworthy in most years around the dawn of the 20th century and not infrequently dwarfed by the body counts racked up in those days.

    • onion2k 4 hours ago
      Snark aside, we have massively more people alive today than in 1900 and yet the proportion of people that die in armed conflicts is— while horrific- barely noteworthy in most years around the dawn of the 20th century and not infrequently dwarfed by the body counts racked up in those days.

      That's true if your definition of 'die in armed conflicts' is limited to 'the soldiers on the battlefield.' If you extend that definition a little to 'people who would not have died if there hadn't been an armed conflict' then you need to scale it up to about a million people a year today. That's just from 5 countries where it's been studied. Globally it's likely to be much more. There's some good information about it, from a credible source, here: https://costsofwar.watson.brown.edu/costs/human

    • bryanrasmussen 4 hours ago
      you also need to compare people injured so badly that they are significantly worse off for life after the war is over, as most of those people would probably have been killed in previous wars but thanks to modern medicine can be kept alive to suffer for years afterwards.

      not a knock on modern medicine, and probably the people who survive are happy that they did for the most part, however if you compare the results in the way you did, you should compare those as well.

  • nilirl 6 hours ago
    I see the pattern the author wants to show me, but what about it?

    Civilization is a complex, evolving system. How much predictability and control do we really have?

  • chihuahua 8 hours ago
    The Gatling quote is hilarious. Did the inventor of the machine gun really think that each company of 100 men was going to be reduced to one guy with a Gatling gun, and 99 of them send him to the battlefield by himself, saying "good luck buddy, let us know how it works out?"

    The army was going to be reduced by a factor of 100, and two tiny armies were going to face off while the majority of men of fighting age were going to sit at home and paint landscape paintings? Really?

    • jdndbdjsj 6 hours ago
      Yet everyone is saying this about LLMs and coders
    • Aerolfos 2 hours ago
      > and 99 of them send him to the battlefield by himself, saying "good luck buddy, let us know how it works out?"

      >The army was going to be reduced by a factor of 100, and two tiny armies were going to face off while the majority of men of fighting age were going to sit at home and paint landscape paintings? Really?

      Well, for a time greek city states did fight pretty much like this. Small armies of hoplites were raised outside harvest season, went out, fought almost show-battles with very few casualties, and tribute changed hands based on the results. Everyone went home for the harvest.

      I believe there's even instances where a battle wasn't fought at all in favour of two appointed champions dueling (origin of the popular fiction trope)

      It didn't last, but for a time the greek city states had a kind of equilibrium with relatively few resources (or people) spent on war.

    • zmgsabst 7 hours ago
      But… it did do that.

      > that it would, to a large extent supersede the necessity of large armies, and consequently, exposure to battle and disease [would] be greatly diminished.

      Our force structure shifted towards logistics and infrastructure from combatants as we moved up the weapon complexity hierarchy. First automatic guns, then tanks, then airplanes.

      To a large extent, a tank or air crew is 50 guys waving off 1-5, while they sit back at base and do hobbies between bouts of mechanic labor. They’re not literally at home, but we do fight with small mechanized armies while most soldiers watch on from the base.

      • closewith 2 hours ago
        Yes, even for infantry, the tooth to tail ratio for deployed expeditionary armies is now 10-20:1. Even that's down from cold war ratios due to mechanisation and automation on the logistics side.
      • AndrewKemendo 5 hours ago
        Right

        It wasn’t over night but it did exactly what it intended and sped up a battle significantly as though you had multiples of troops compared to a musket firing line

        Then miniaturized it becomes the SAW

    • 01HNNWZ0MV43FF 6 hours ago
      A little "How many people were soldiers in ancient Rome" type searches gave me these numbers...

      16% of adult males in the Roman mid-republic (https://en.wikipedia.org/wiki/Roman_army_of_the_mid-Republic...), call that 8% of adults of all genders.

      Wikipedia says that there's about 1.34 million people in active duty in the US military, out of about 342 million people, 21.5% of which are under 18. (https://en.wikipedia.org/wiki/Demographics_of_the_United_Sta..., https://en.wikipedia.org/wiki/United_States_Armed_Forces)

      I think that's 0.5%? Down from 8% in ancient Rome?

      • applfanboysbgon 4 hours ago
        That has little to do with technological advances, just the fact that the US is at an imperial peace; ie. it is under zero threat of invasion and is currently only engaged in small-scale imperial adventurism across the globe which does not require a large standing army. ~16% of adult Americans served in WW2, or ~33% of adult men.
        • closewith 2 hours ago
          Is Iran enjoying an imperial peace, too?

          Even including Aative + reserves + paramilitaries, less than 2% of Iranian adults are in the military.

          • expedition32 49 minutes ago
            Iran hasn't fought a ground war since the (America backed) Saddam invasion.
    • mmcromp 7 hours ago
      I don't know if this is your point, but we're hearing the same stores with AI. Do these people really mean what they say or are they just lying to paint themselves as honorable
    • closewith 2 hours ago
      US/Israel and Iran each have millions of military and military-industrial personnel, and yet the actual combat is being performed by a few thousand at most. There might a thousand people in uniform for each one directly engaging the enemy (flying a sortie, launching a missile, firing a torpedo) on any given day.
      • orbital-decay 2 hours ago
        That's because there's no ground invasion (yet).
  • morninglight 9 hours ago
    We need to break this pattern of kinetic weapons.

    How about some modern, safe bio-weapons.

    • rationalist 9 hours ago
      It has bio in the name - it must be good!

      That means they're made from renewable resources, right?

      • coffeebeqn 7 hours ago
        As long as they’re USDA Organic
    • jiehong 7 hours ago
      I just watched an episode of Babylon 5 in which an entire race gets wiped by a virus in that way In a matter of days.
    • zabzonk 5 hours ago
      How do you test "safe bio-weapons"?
    • ares623 6 hours ago
      Clincally proven bio-weapons
  • hackyhacky 9 hours ago
    tldr: many great scientific advancement were created by well-intentioned researchers who were subsequently shocked to find their work applied to military, often to the great detriment of mankind.

    The unwritten implication is that this applies to AI, as well. I find it hard to disagree. I don't know what to do about it.

    The HN crowd is elated that we can finally finish our side projects, while the ruling class is already using AI to subvert democracy, spread misinformation, and develop weapons. "If we don't build these weapons, someone else will." If we can learn nothing else from history, we should learn that you can't turn back the clock.

    • 3836293648 7 hours ago
      No, this does not apply to AI because they're not well intentioned and very open about it.
    • lich_king 8 hours ago
      I think both things can simultaneously be true. There is a certain inevitability to technological progress. Once you reach a critical mass of collective knowledge, the resulting "thing" will get developed. If not by you, then by someone else.

      But also, inevitability is not an argument for complicity. If you personally decide to work on bioweapons, I don't think you can shrug and say "eh, it was going to happen either way". As tech workers, we've really mastered the art of coming up with justifications for what essentially just boils down to "all my friends have gotten rich and now it's my turn".

      I've met hundreds of sharp engineers from Facebook, Google, Microsoft, etc. None of them could look me straight in the eye and say "yeah, you know, what we're doing with ad tech is actually good". They just always had an explanation along the lines of "it's not that bad, and besides, if we don't do it, someone else will, and we're the good guys here".

      • godelski 6 hours ago

          > besides, if we don't do it, someone else will, and we're the good guys here".
        
        It's funny that people justify themselves that way considering it's the literal phrase is discussed in every ethics 101 course... and not because a bunch of good people were saying it...
        • bluefirebrand 5 hours ago
          If the comments on this website are any indication I'd wager a great many people in tech haven't spent even a single minute of their lives seriously thinking about ethics, nevermind studying ethics in a classroom
          • bdangubic 5 hours ago
            - first 10 years of my career, ethics was last thing on my mind

            - second 10 years of my career, started seriously thinking about ethics

            - last 10 years of my career (including now) - would not work for Big Tech etc if they gave me 9-digit / year compensation package

            • user2722 2 hours ago
              That has probably more to do with you bank account digits.

              I'm on the inverse moral ladder currently, specially as more and more services are privatized (public health here is on fast-track to be americanized).

              • watwut 1 hour ago
                I see so many rich people act in awfull manner just to get mote money ... so no.

                People who make ethical decisions end up with less money on average. But that is it, poor people and low paid people and average paid techies make ethical decisions all the time.

            • bluefirebrand 2 hours ago
              I guess that's why I'm always angry when I'm reading comments here

              I know I don't have all the answers, but I minored in philosophy in school. I studied ethics quite a lot and being ethical has always been very important to me

              I never had 20 years of "let's burn down everything in my way as long as it pays well"

              • user2722 2 hours ago
                Do you have privatized healthcare in your country?
        • 9dev 5 hours ago
          Yep. From Putin to Kim Yong Un, everyone is convinced to be the good guy doing bad things for the right reasons.
    • 6177c40f 9 hours ago
      Reminds me a quote from Gibson's Spook Country: "That's something that tends to happen with new technologies generally: the most interesting applications turn up on the battlefield, or in a gallery."
    • vlovich123 7 hours ago
      That’s a weird tldr and not my takeaway. More like “scientists convinced their new ultra destructive weapon is sure to bring about peace this time around”. Spoiler: it does not. Arguably maybe nuclear weapons but even then I’d say the use of nuclear weapons in armed conflict hasn’t really been tested yet and people are generally hesitant to do so, preferring instead illegal chemical and biological warfare.
    • godelski 7 hours ago

        > The HN crowd is elated that we can finally finish our side projects, while the ruling class is
      
      happy that they can finish their side projects too.
    • nwhnwh 7 hours ago
      If you wanted the core of all of this... Check this book "Irrational Man" by William Barrett.
    • porridgeraisin 4 hours ago
      > were created by well-intentioned researchers who were subsequently shocked to find their work applied to military

      oh please.

      Most scientific development especially root-node stuff has been funded and kick-started by the military for centuries. You can't take funds from DARPA and then be shocked to see the air force using it. You can't work at ecole polytechnique and be shocked to see your work being used in libya.

      Humans would have never gone to space [as quick and as at much scale as they did] if they didn't want spy satellites and ICBMs.

      Shannon invented a whole new field while working with money earmarked for cryptography work in WW2.

      Machine translation was first posed and funded by anyone for russian-english translation - 1949 Warren Weaver memo at the Rockefeller Foundation.

      Do see my other comment for more examples.

      https://news.ycombinator.com/item?id=45364917

      https://news.ycombinator.com/item?id=45365211 [Context: the creator of waymo was the winner of that challenge]

      And need I mention the internet itself...

      As the first comment I linked mentions, even many medicines were developed only cos soldiers were dying in theater, not because normal people were dying at home. So it's not just limited to tech.

      > the ruling class

      No, we don't get to deflect blame like that. If we take money from DARPA/similar to invent something, we are part of the system and are responsible. Everyone involved in the space race in the 50s, Transit (sat nav) in the 60s knew it was to make ICBMs. The creator of waymo surely read that DARPA document I linked in my second comment. And need I mention that oppenheimer knew why nuclear energy was being harnessed :) You can't "oh the evil few tricking the innocent majority, what ever will they do" it away.

      A logically defensible position might be that you agree that war is a timeless motivation and that you are fine with stuff being used for military purposes and continue to develop the technology with government money, OR not taking any money from the government. There are not that many others that aren't hypocritical.

  • MediaSquirrel 7 hours ago
    Nukes gave us peace and freedom.

    We've had no WW3 (so far) and no one here needs to worry about being drafted into a war. Gatling might have thought his gun would reduce the number of war fatalities, but but Oppenheimer thought he would end the world. Both were wrong.

    Alternative take: Inventors are bad at predicting the downstream societal effects of their inventions.

    • treebeard901 7 hours ago
      Let's assume a nuclear exchange happens at some point during a war. There is a very high chance that this will cause an escalation leading to a nuclear apocalypse.

      Since this result is presumably inevitable at increasing frequency, it's more like nukes prevented another major world war and stole a form of peace from the future, temporarily. That peace debt might be repaid with the end of everything.

      • KronisLV 5 hours ago
        • nehal3m 4 hours ago
          Funny how the unintentional close calls become more sparse with time. I wonder if that’s because humanity got better at dealing with the responsibility or because the oopsies haven’t been declassified yet.
      • testaccount28 6 hours ago
        let's assume the trees rise up and set fire to the ionosphere.
      • ares623 6 hours ago
        well whatever society is left will definitely be "peaceful" for at least a couple of decades.
    • jiehong 7 hours ago
      It very much depends on where "here" is.

      At least, it gives impunity to attack others with less fear of retaliation…

    • zabzonk 6 hours ago
      > no one here needs to worry about being drafted into a war

      Lots of talk in the UK recently about conscription.

    • imjonse 4 hours ago
      > no one here needs to worry about being drafted into a war.

      here meaning the US or HN?

    • expedition32 44 minutes ago
      Nuclear PROLIFERATION gave us peace and freedom.

      The Americans wanted to keep it all to themselves you know...

    • wat10000 6 hours ago
      Nuclear weapons traded a high probability of a major war for a low probability of an apocalyptic war.

      My question is, how low is that probability, exactly? Because the tradeoff looks very different if it’s one in a million per year, versus one in a hundred per year.

      My assessment, looking at the history and the close calls, is that it’s more like one in a hundred.

      • 9dev 5 hours ago
        It certainly rises if the USA votes for an irresponsible crook.
  • XorNot 8 hours ago
    This is such a tiresome take. Anything is a weapon if you work hard enough at it, but do you really think the main thing that will stop us killing each other is access or lack thereof to weapons?

    Like we have prehistoric skeletons with obvious signs of traumatic injury inflicted by tools.

    • hackyhacky 8 hours ago
      > Like we have prehistoric skeletons with obvious signs of traumatic injury inflicted by tools.

      No one is arguing that modern technology is the sole or even principal cause of military deaths. The argument is simply that technology has greatly facilitated the ease and scale.

      Imagine a world without nuclear weapons, automatic weapons, rockets, and explosives (other than gunpowder). There would still be wars, certainly, but they would be a lot less destructive.

      • XorNot 8 hours ago
        The number of casualties from the American civil war was estimated at 700,000 soldiers from both sides.

        The death toll from Hiroshima and Nagasaki is estimated at about 200,000.

        Nuclear weapons have killed far fewer people then any other type in history, whereas the musket did some work.

        And you know, a bunch of Romans with the pinnacle of technology - the sharp thing on a long stick - in the Battle of Carthage collectively had about 100,000 casualties and also demolished a city. And that was one of many battles in many wars.

        The masses of man and ground into the masses of man in conflict, at scale, at every turn that we've had organized society. We live in a time where casualty scales are actually shockingly low in conflict.

        • chihuahua 8 hours ago
          Interesting perspective. One could argue that nuclear weapons are among the less harmful things invented, since they killed fewer people than knives, clubs, spears, guns, cars, cigarettes, alcohol, asbestos, coal power plants, and probably a lot of other things. Plus they probably prevent a 3rd world war with killing on the same scale as WW1 and WW2, tens of millions each.
          • AdamN 5 hours ago
            Yeah that's part of Nuclear Peace Theory. It's interesting and compelling - but also prone to some major tail risk.
          • 9dev 5 hours ago
            They prevent the third world war, until they don’t. Then they will bring mayhem and misery. And with the current lunatics in charge I am not really at ease just because nobody pushed the big red button yet.
        • vlovich123 7 hours ago
          You’re comparing a 4 year bloodbath to 10 minutes and being underimpressed? Also those weapons are several orders of magnitude less powerful than what they’re capable of today…

          Battle of Carthage was also 3 years and was a siege of a city, so you know… not a lot of places for the people inside to escape. Also took about 20-50k expertly trained Roman soldiers vs a few trained guys in a plane pressing a button.

          And sibling comment is right. The application of industrialization to the death process in WW2 and similar application of the idea (eg Pol Pot and Stalin) also led to death on an unprecedented scale.

          • jryle70 6 hours ago
            > 4 year bloodbath

            That caused endless tragedy and trauma. Perhaps the 10 mins terror was the less worse outcome of the two, mode decisive, that ended the war quicker. Who can decide? Wars aren't statistic.

            • watwut 1 hour ago
              WWII was not 10min of terror. Those 10min was small part of 5 year long warfare. Which caused endless trage and trauma.

              So, if you want to make apples to apples comparison, compare it to how many people a small unit killed on 10min.

          • nwhnwh 7 hours ago
            > You’re comparing a 4 year bloodbath to 10 minutes...

            Poor me having hard time trying to understand how he didn't notice that by himself.

        • hackyhacky 8 hours ago
          > The death toll from Hiroshima and Nagasaki is estimated at about 200,000.

          Nice of you to omit the 50 million other civilian casualties in WW2, plus around 20 million military casualties a 5 million prisoners. Nothing in the classical world comes close to that left of destruction.

          • testaccount28 6 hours ago
            famously, the bombs were what _ended_ the war.
        • watwut 1 hour ago
          You literally refenced WWII. Which features a peek of people killed in military conflict. And yes, holocaust counts, civilian deaths by soldiers count.
  • throwaway290 5 hours ago
    nobody here noticed?

    None of them were women.

    • synecdoche 3 hours ago
      I'm puzzled to what point is tried to be made.

      Is the parent statement supposed to be an argument that women are not capable, or even less likely, of providing means for, or inflicting massive destruction?

      How would that follow from what is said here or in the article?

      Certainly women can be destructive too. What would make it a sex issue?

  • arjie 5 hours ago
    This business about Alberto Santos-Dumont does put most of the thing into question:

    > North Americans think the Wright Brothers invented the airplane. Much of the world believes that credit belongs to Alberto Santos-Dumont, a Brazilian inventor working in Paris.

    Much of the world? It's a minority viewpoint both among scholars and lay people. Some people in the insight porn "actually, the thing they won't tell you" genre of blogs and so on also do it. Certainly it's standard in China and India, so at the least you have to put Asia on that list as well. And Wright is the standard teaching in Australia, and the UK, Germany, Italy, and Spain. Egypt and Botswana and I'd be surprised if other places in Africa are different.

    In general, when I look in my rice at a restaurant and I see a cockroach, I assume there are more cockroaches in the restaurant. So, too, I assume there are other cockroaches in this article. I don't have the time to verify the other things, but this is wrong enough that I'd rather eat elsewhere.

    • weinzierl 4 hours ago
      Nah, before the Internet if you asked a random German on the street, who'd they think invented the airplane I'm pretty sure you'd had gotten Otto Lilienthal as an answer. I guess the reality is that before the world got hyper connected every country had its own set of inventors for almost everything. There are numerous examples but they are hard to find now.

      In the early days of Wikipedia I thought about writing a crawler that makes a table with inventor per country. It would have been an interesting experiment. Maybe it could be done with an archive even now.

      • arjie 4 hours ago
        I'll happily grant that claim but today it is after the Internet was invented and therefore this "much of the world believes" claim from OP is nonsense since it uses the present tense.
      • astrolx 4 hours ago
        And in France you'd have gotten Clément Ader as reply.
    • reshlo 4 hours ago
      Dozens of credible witnesses, including several who authored sworn affidavits, claim they saw Richard Pearse achieve powered flight before the Wright brothers. Pearse is a much better option if someone wants to claim the Wright brothers were not the first.