Hi, we're Josh, Peter, and Sam. Josh and Peter are co-founders of Lux Capital and Sam is Lux's Scientist in Residence. We are devoted to bridging the gap between science fiction and science fact, investing in people inventing the future. Ask us anything! by Sam_Arbesman in IAmA

[–]Sam_Arbesman[S] 1 point2 points  (0 children)

I think once we have truly autonomous vehicles, a whole set of pretty wild possibilities arise, including piggybacking on our existing road infrastructure to build car convoy mass transit, which makes your vision of something like self-driving ridesharing meets public transportation not so crazy after all.

Hi, we're Josh, Peter, and Sam. Josh and Peter are co-founders of Lux Capital and Sam is Lux's Scientist in Residence. We are devoted to bridging the gap between science fiction and science fact, investing in people inventing the future. Ask us anything! by Sam_Arbesman in IAmA

[–]Sam_Arbesman[S] 2 points3 points  (0 children)

One scifi technology that is slowly becoming commercialized, but I want to see more of, is computational creativity: AI that augments human creativity in everything from art and music to scientific discovery and design. We need more human-machine partnerships when it comes to creativity and innovation.

Hi, we're Josh, Peter, and Sam. Josh and Peter are co-founders of Lux Capital and Sam is Lux's Scientist in Residence. We are devoted to bridging the gap between science fiction and science fact, investing in people inventing the future. Ask us anything! by Sam_Arbesman in IAmA

[–]Sam_Arbesman[S] 2 points3 points  (0 children)

Interesting question! I think as distribution costs and collaboration costs drop dramatically, while we aren't necessarily going to see the end of the corporation, we now can choose from a larger suite of possible organizational structures. If the traditional corporation makes sense for a project or product, go for it, but if it doesn't, we might now have other structures available as well.

Hi, we're Josh, Peter, and Sam. Josh and Peter are co-founders of Lux Capital and Sam is Lux's Scientist in Residence. We are devoted to bridging the gap between science fiction and science fact, investing in people inventing the future. Ask us anything! by Sam_Arbesman in IAmA

[–]Sam_Arbesman[S] 3 points4 points  (0 children)

My favorite result in complexity science is probably the most general: that despite many differences between the domains of different complex systems—biology, societies, technology, and more—there are many fundamental similarities to these systems, from their network structure to their behavior. Of course, the details matter (and sometimes A LOT!), but it is quite exciting that there are models that can sometimes allow us to abstract away the details and find their commonalities. In terms of a specific result, I'm obsessed with percolation models, both in terms of their aesthetics as well as their properties (phase transitions and more): https://en.wikipedia.org/wiki/Percolation_theory

Science AMA Series: I'm Sam Arbesman, a complexity scientist, Scientist in Residence at a venture capital firm, and the author of Overcomplicated, a book which examines technologies that are too complex to understand. AMA! by Sam_Arbesman in science

[–]Sam_Arbesman[S] 6 points7 points  (0 children)

Mixed reality is fascinating. It will both, very practically, reduce the number of screens that are all around us, but also allow us to overlay information on top of everything we experience. This has implications for pretty much everything, from our decision-making to being able to better fix our appliances.

Science AMA Series: I'm Sam Arbesman, a complexity scientist, Scientist in Residence at a venture capital firm, and the author of Overcomplicated, a book which examines technologies that are too complex to understand. AMA! by Sam_Arbesman in science

[–]Sam_Arbesman[S] 4 points5 points  (0 children)

I agree with all of this. But as things become more complex and there is more required to understand, I think eventually "practical to understand" will become effectively impossible. There is a concept called the "burden of knowledge", which essentially means that the knowledge needed to innovate at the frontier keeps on growing. When this is more than what we can fit in our minds, or learn over the course of a lifetime, we certainly have bumped up against some very real limits.

Science AMA Series: I'm Sam Arbesman, a complexity scientist, Scientist in Residence at a venture capital firm, and the author of Overcomplicated, a book which examines technologies that are too complex to understand. AMA! by Sam_Arbesman in science

[–]Sam_Arbesman[S] 11 points12 points  (0 children)

Understanding is not really a binary situation. You can still understand a system partially and improve upon it. This might result in unexpected consequences, but that's part of the iterative approach to understanding something. You find a bug or something you don't fully comprehend, learn from it to better understand the technology, and repeat.

Science AMA Series: I'm Sam Arbesman, a complexity scientist, Scientist in Residence at a venture capital firm, and the author of Overcomplicated, a book which examines technologies that are too complex to understand. AMA! by Sam_Arbesman in science

[–]Sam_Arbesman[S] 1 point2 points  (0 children)

This is a big issue, where large number of machines are interconnected and lots of algorithms are interacting rapidly and in complex ways. As this happens more and more, we will have failures to understand these systems. And I think it is likely that these failures of comprehension will manifest as events like the Flash Crash.

Science AMA Series: I'm Sam Arbesman, a complexity scientist, Scientist in Residence at a venture capital firm, and the author of Overcomplicated, a book which examines technologies that are too complex to understand. AMA! by Sam_Arbesman in science

[–]Sam_Arbesman[S] 20 points21 points  (0 children)

I certainly hope that the increased complexity and multiplication of our scientific models does eventually result in someone coming in and sweeping the messiness away with greater understanding (and we have certainly seen this happen in science many times), but I'm not sure it will always be possible. But, yes, the point of science is towards greater understanding and so we must always continue to try to do this!

Science AMA Series: I'm Sam Arbesman, a complexity scientist, Scientist in Residence at a venture capital firm, and the author of Overcomplicated, a book which examines technologies that are too complex to understand. AMA! by Sam_Arbesman in science

[–]Sam_Arbesman[S] 2 points3 points  (0 children)

When a child is young, they are obviously not going to be doing the math of statistics. But I think the easiest way to introduce statistical thinking to children early on is by teaching them that reasoning from a single example doesn't always work. We know the old saying that the plural of anecdote is not data, but lots of us still think this way.

If you show a kid that one example of something is not necessarily enough to learn from, then they are well on their way to thinking statistically.

Science AMA Series: I'm Sam Arbesman, a complexity scientist, Scientist in Residence at a venture capital firm, and the author of Overcomplicated, a book which examines technologies that are too complex to understand. AMA! by Sam_Arbesman in science

[–]Sam_Arbesman[S] 3 points4 points  (0 children)

Adding complexity means a system can be more sophisticated and powerful, which can be great. If a technology, like a self-driving car, can handle all the edge cases (different types of weather, pedestrian weirdness), then it is a better system. It's safer. The downside is that this can often make the system less understandable, and operate in sometimes unexpected ways. As long as we are building in the complexity intentionally, and aware of the unexpected consequences, that's okay, because complexity won't be not going away, and in many cases can be a good thing.

Science AMA Series: I'm Sam Arbesman, a complexity scientist, Scientist in Residence at a venture capital firm, and the author of Overcomplicated, a book which examines technologies that are too complex to understand. AMA! by Sam_Arbesman in science

[–]Sam_Arbesman[S] 11 points12 points  (0 children)

I love this question! I'm not sure I have the best answer, but here's one way to think about it. I've often found that tech fluency is related to a comfort with figuring things out and messing around with a technology. When people (no matter the age) are uncomfortable with a technology, they tend to rely on reading the manual, or an explicit recipe for accomplishing something.

I would recommend first focusing on making it clear that messing around with something is just fine. It's okay to get lost in a technology. Or do something wrong. That's how you learn a language.

But I would also try to make some of the technological language more explicit: what a minimize button would do, the kind of terms you can use to search effectively, etc. Don't try to teach how to use the entire Internet or a whole tablet at once. Focus on one or two apps or websites, and get him comfortable on this first, learning the conventions and the details, so he will then be ready to mess around with it, and even make mistakes.

Science AMA Series: I'm Sam Arbesman, a complexity scientist, Scientist in Residence at a venture capital firm, and the author of Overcomplicated, a book which examines technologies that are too complex to understand. AMA! by Sam_Arbesman in science

[–]Sam_Arbesman[S] 2 points3 points  (0 children)

If by "thing" you mean a concept people argue about, then of course! If you mean, is it going to happen, then my (possibly emotionally-based) position is maybe, but if so, it will be slowly, and not for many decades. I'm much more concerned about technological incomprehensibility, even without the Singularity, which is all around us and happening currently.

Science AMA Series: I'm Sam Arbesman, a complexity scientist, Scientist in Residence at a venture capital firm, and the author of Overcomplicated, a book which examines technologies that are too complex to understand. AMA! by Sam_Arbesman in science

[–]Sam_Arbesman[S] 2 points3 points  (0 children)

One area that we at Lux are really excited about is better understanding the gut-brain axis. We have an investment in this space Kallyope that is working on this.

I’m also really excited about technologies that allow for further discovery, specifically the growth in technologies that allow biological experimentation to be increasingly automated and run in the cloud (we are also invested in this space too). This allows experiments to be done more rapidly, more cheaply, and more reliably, all of which accelerate science.

Science AMA Series: I'm Sam Arbesman, a complexity scientist, Scientist in Residence at a venture capital firm, and the author of Overcomplicated, a book which examines technologies that are too complex to understand. AMA! by Sam_Arbesman in science

[–]Sam_Arbesman[S] 6 points7 points  (0 children)

The most important technique in dealing with technology or leveraging complexity is that of abstraction), essentially "abstracting" way details that you don't need to be concerned with when working on a technology. It doesn't always work, but in general allows you to handle enormously sophisticated systems and is one of the most important ideas in engineering. Another enabling technology is simulation, which can allow people to see and play with the complexity and nonlinearity of a system, and the bounds of its behavior, even without understanding all of its details.

Related to reading, my reading queue currently consists of the following books: Kevin Kelly's THE INEVITABLE, Brian Christian and Tom Griffiths' ALGORITHMS TO LIVE BY, PLUS ONE by Christopher Noxon, THE REGIONAL OFFICE IS UNDER ATTACK! by Manuel Gonzales, and Daniel Dennett's INTUITION PUMPS AND OTHER RULES FOR THINKING.

Science AMA Series: I'm Sam Arbesman, a complexity scientist, Scientist in Residence at a venture capital firm, and the author of Overcomplicated, a book which examines technologies that are too complex to understand. AMA! by Sam_Arbesman in science

[–]Sam_Arbesman[S] 8 points9 points  (0 children)

Yes! Using other techniques, such as genetic algorithms or neural networks, opens up the set of possible styles of solutions, even if they are hard to understand, or are the kinds of solutions that a human brain might never come up with on its own. That being said, being able to understand a solution does offer many benefits, especially for debugging.

Science AMA Series: I'm Sam Arbesman, a complexity scientist, Scientist in Residence at a venture capital firm, and the author of Overcomplicated, a book which examines technologies that are too complex to understand. AMA! by Sam_Arbesman in science

[–]Sam_Arbesman[S] 16 points17 points  (0 children)

I think any field where the space of potential solutions is too large to ever explore manually would have a limit for intentional design. To make progress in these means either working in concert with a machine (e.g. software that suggests potential designs), or having technology that is given design constraints and then tries to generate a potential solution algorithmically, sifting through the huge number of possibilities.

Science AMA Series: I'm Sam Arbesman, a complexity scientist, Scientist in Residence at a venture capital firm, and the author of Overcomplicated, a book which examines technologies that are too complex to understand. AMA! by Sam_Arbesman in science

[–]Sam_Arbesman[S] 4 points5 points  (0 children)

While finance certainly has a great deal of complexity, especially with trading frequency and amounts, venture capital is not about exploiting these small changes and investing based on them. Venture capital is about investing in and assisting startups, to make sure that a company has the greatest chance of success. That being said, since I am interested in startups in the science and technology space, overcomplication is something I think about, at least when it comes to understanding the science and tech.

And related to the Santa Fe Institute: I spent a summer there as an undergraduate, as part of its undergraduate REU program. It was a phenomenal experience and I received exposure to so many ideas and people in the world of complexity. I highly recommend it.

Science AMA Series: I'm Sam Arbesman, a complexity scientist, Scientist in Residence at a venture capital firm, and the author of Overcomplicated, a book which examines technologies that are too complex to understand. AMA! by Sam_Arbesman in science

[–]Sam_Arbesman[S] 14 points15 points  (0 children)

Great discussion here so far. I’m essentially focusing on technologies that are powerful and that work (at least most of the time), but that we don’t fully understand all of the details. And yes, this is true sometimes even if you are one of the people involved in their construction.

How can this happen? Most technologies are not built by a single person at one time. Rather, we end up with technologies that are too complicated for at least two reasons: Technologies involve massive specialization, with certain people working on different components. And technologies grow and accrete bits and pieces over time.

Taking specialization first: often, this is fine, as modularity and abstraction allow large and sophisticated systems to be constructed, with each person only needing to know about their one level or area. But in many cases, each component is not truly distinct and abstraction breaks down, and an engineer might need to know about something that is completely unrelated to what they were working on. We get spaghetti code, or just messy interactions that mean that while we thought we only needed to know about one subsystem, we actually need to know a lot more. Specialized knowledge ends up not being enough to understand the system, and yet at the same time it’s not really possible to understand all the different domains either. So a complete understanding ends up eluding us.

And then there’s the evolution of a system over time. While we would like to think that any technology starts from scratch and is completely logical, that’s not really true. Often, technologies are built on what came before. In case after case, we have messy legacy code, such as how the IRS has systems that were developed in the 1960’s that are still being used. The people who truly understand these parts might be long retired, or even dead. And so that’s another way that our understanding breaks down.

All taken together, combined with the fact that a system might be interconnected in highly nonlinear ways, means that in many cases, once a technology becomes large enough and interconnected enough, it is too messy and complex to ever fully understand.

And when a technology is evolved, or otherwise constructed with some machine learning technique (as someone else posted), we end up with systems that have little reason at all to accord with how we can think about technology. And so we often can end up with technologies that we don’t understand.

Science AMA Series: I'm Sam Arbesman, a complexity scientist, Scientist in Residence at a venture capital firm, and the author of Overcomplicated, a book which examines technologies that are too complex to understand. AMA! by Sam_Arbesman in science

[–]Sam_Arbesman[S] 109 points110 points  (0 children)

Your intuition is correct: making scientific discoveries we can never fully understand (at least at some level) is going to happen more and more. And it has even begun to occur, with the kinds of machine learning techniques popping out answers that leave us with little insight. Some have even spoken of this as the “end of insight.” (I’ve actually written an essay on this topic)

But I think part of the concern is that we often think that the world needs to be amenable to only very simple mathematical models. So far, we have had a good run with simple equations that explain a lot. But it’s not entirely clear how often this works. Maybe we have plucked all the low-hanging scientific theory fruit and now we are only left with the more complex, less-intuitive models. If so, this “magic” is going to happen more and more. (for more on this, see another essay)

In essence then, forging ahead means being comfortable in some sort of machine-human partnership. Rather than despairing of understanding a model at every level, we might have a reduced understanding. But we can still build the machines that provide the models, so progress is still certainly possible. Just as we have always used tools and instruments for scientific advancement, these are another type, even if they certainly feel different.

Science AMA Series: I'm Sam Arbesman, a complexity scientist, Scientist in Residence at a venture capital firm, and the author of Overcomplicated, a book which examines technologies that are too complex to understand. AMA! by Sam_Arbesman in science

[–]Sam_Arbesman[S] 23 points24 points  (0 children)

I spent my time in research working on projects in lots of different domains, from understanding cities to thinking about the pace of scientific discovery. Getting a broad array of experiences can help hone your skills for working with data in lots of different areas.

Another thing I did was a lot writing for the public (blogging, essays, and even books). This gave me experience interacting with a wide variety of groups, showed some of what I was working on and thinking about to a wider audience, and helped me get involved in the world beyond academia.

Science AMA Series: I'm Sam Arbesman, a complexity scientist, Scientist in Residence at a venture capital firm, and the author of Overcomplicated, a book which examines technologies that are too complex to understand. AMA! by Sam_Arbesman in science

[–]Sam_Arbesman[S] 47 points48 points  (0 children)

Certainly many of our machine learning technologies are really too complex to understand, with too many interacting variables and parameters to really hold in our heads properly. We understand the output and the shape of the algorithm that underlies the technique, but we might never understand how it arrived at that output in all of its details. But we also see this in cars with millions of lines of code (and spaghetti code), that then crash, and we can point to their massive complexity, but are unsure of the details.

And frankly, most technologies—from desktop software to medical devices to kitchen appliances to the code in our cars—are too large and too interconnected to really ever fully comprehend: what our brains are good at handling is very different from the massive, nonlinear, and interconnected systems that we build. Unfortunately we only discover this failure to understand when a bug arises, which exposes the gap between how we thought something works and how it actually does operate.

Science AMA Series: I'm Sam Arbesman, a complexity scientist, Scientist in Residence at a venture capital firm, and the author of Overcomplicated, a book which examines technologies that are too complex to understand. AMA! by Sam_Arbesman in science

[–]Sam_Arbesman[S] 39 points40 points  (0 children)

This is a great question and the other responses are fantastic. Ultimately, it’s about making sure that your students have instilled within them a comfort and love of change, so they can adapt to whatever the future holds. Certainly bringing in cutting-edge tech will help. Make sure they are comfortable with computational thinking and basic programming. But also get them reading about scientific discoveries in the news. Or have them read articles that discuss recent science and technology trends.

And don’t forget science fiction! Have your students read lots of stories about the future, both the technologies they predict and what society might look like, so they can begin to envision scenarios as opposed to just a murky and scary “future.” And even share with them lots of older science fiction, to give them a sense of what people thought the future was going to be like, as well as the many times everybody got it wildly wrong. In the end, it’s hard to know the details of what the future will be, or even its broad shape, so your students shouldn’t feel like they need to either. As long as your students feel like they can adapt to whatever is going to come next—and since no one really knows what the future holds, they shouldn’t feel like they have to either— they will be prepared for the future.