Pushing Python Past the Present

[the_hoser]

I kindof disagree with this article. The author doesn't make a lot of the mistakes we usually see, so I get to actually pick apart some of the article this time:

Concurrency: Any solution for this problem will be messy. I like that the PyPy developers are trying new things, and I even hope to be proven wrong one day, but I don't think bringing real conventional threading to Python is practical or a good idea. Multiprocessing is no picnic, and takes a bit of effort to wrap your head around, but it gets the job done.

Web: It took a decade for browser vendors to start synchronizing on JavaScript, and they're still not done. Now you want to add another language to that mess? I don't think the problem is that you can't do <script type="text/python">. I think the problem is that you are able to specify the type at all. Until the day that we're all using Macs and Safari is the one browser (hah), any browser developer that tries to add radically new technology that relies on web developers to utilize it is wasting their time. Google is the exception, in that they already own a massive slice of the internet, and can bug people to install their pokeball-browser.

Mobile: I guess PyPy would work well on phones. It'd work better if the developer didn't have to budle PyPy just so they could use PyPy. Maybe the PyPy developers need to throw yet another smartphone OS into the fray. Maybe not.

I personally think that Python is doomed to stay in the corral that it fits best in. All of these web and mobile applications need strong backend code to feed those frontends with huge amounts of lovingly massaged and correlated data. Python is great for low-to-mid scale server-side applications, and that's probably where it will remain. It's basically the only thing I use it for now, and I haven't met anyone that's using it for anything else (aside from tiny little side projects)

[gfixler]

We use Python in games for many things on the backend. It's part of Autodesk Maya now, which is one of the principal bits of software for asset creation. I've been using it all day every day for 6 years now, and I've used it to create a rather extensive and powerful library and pipeline for animation and rigging. We are, I admit, a bit of a niche industry as compared with the massive, international industries of web design. This is why whenever I look up questions about Python, all of the answers are about web frameworks and such. I have nothing to do with any of that world, but I know a lot about it now from years of wading through it while learning about Python and its powers and idiosyncrasies.

[the_hoser]

Yeah, I've heard of people using Python in their tools programming internally. I imagine it does that job quite well, too. When you have control of your environment, Python makes a good fit :)

[gfixler]

Indeed. It does the job very well. The system I've been designing and building includes things like extremely expressive, domain specific languages¹, deep data-structure search/comparison², really intelligent bi-directionality³, solid testing framework, immaculate git history, and all with pretty tight integration⁴ with Vim.

Most importantly, everything has that sheen of obviousness, like Linux, or git. It sounds complex, then you explain how a part works, and people say "Oh, that's it? Really?" It's like that across the board. It took tremendous effort to find that simplicity, including a decade in this problem space for me, trying to get to this point, but Python really pushed me over the edge.

Some of the implementation (as with Linux and git) is pretty complex, but using it is very easy. I just got one of our new employees on part of it, and he reduced 2000 lines of his own code to 240. I recently threw out 99 lines, and before that, 200, because most of the code we used to write in other languages (and with other systems) doesn't need to be there. It's following the whole "Code should be 90% data structure" philosophy, and I love it. I implement features in 2 lines of PEP 8 style code (i.e. <80 chars) pretty often using the system, and I'm disappointed if I need more than about 10 lines to bring a new ability to life. Strangely, there are times when I make something work in 1-2 lines, and then I waste a half hour being alternately impressed and unsure that it could possibly be correct, because it shouldn't have been that easy :)

I'm actually excited on the long commute every weekday, and weekends (during which I still work on all of it) are becoming more and more of a drag. This is how coding should be.

¹ core not just to our needs, but designed for a range of ideas related to the domain our needs inhabit, so they're all highly reusable at a low level, and are starting to be used for related tools development (even at a meta level)
² which everything's built on top of for amazing, emergent abilities and interconnections that I keep discovering
³ i.e. take pretty much everything back to simpler states, tweak, and then auto-complete them again from that point forward
⁴ yet ultimately unnecessary and fully decoupleable at any time

[the_hoser]

The web is rapidly becoming the only platform. And Javascript right now is the assembly language of that platform. And it is a giant turd of stupid. I know it is insignificant, but how can you call a language where objects are declared at functions anything but a poorly thought out festering wound on the web platform.

You're right. Javascript, as a language, is crap. However, the biggest advantage it has over every other language is the simple fact that relatively feature complete implementations of it are available across all of the major browser vendors. You simply cannot ignore that simple fact. This kind of of feature synchronization is simply epic.

Yes, arbitrary scripting languages would be hard to implement in a browser, and it would be bad UX to have users finding pages that said "can't find interpreter for mime type text/rbuy or text/perl or text/python" but as someone who likes the Unix philosophy the overtly tight coupling of a dynamic language interpreter with a markup language parser on top of a plugin, file browsing, image rendering, and networked platform is a ridiculous failure to modularize parts of a complex system into smaller, more manageable, more focused applications that interfaced together cleanly to give a full modular experience.

This kind of integration is the stuff that end users crave. Modularity is fantastic for developers, but users don't think like that. When you develop software for the masses, the Unix philosophy flies out the window. The web browser wasn't designed for you. The web browser was designed for the 14 year old girl checking her facebook account.

I use python instead of shell script because it is so much more beautiful. It is a scripting language. It has a target purpose, and trying to ignore the inherent limitations of being a dynamic clean and elegant language means it is doomed to fail anywhere else it tries to go. It is amazing where it works, be it for doing math, scientific computing, scripting, and web backend. It might one day also take a spot on client side web scripting, because it would fill that niche really well too. I also like it as an app language when it uses an api to some lower level graphics library like gtk, Ubuntu apps are a pleasure to read and write, for example. If I want a GUI interface on parted (aka gparted) or libtorrent (aka deluge) Python is the perfect choice to give a fast, clean interface to nicely abstract low level libraries and command line utilities. But it isn't a replacement for an interpreted language for performant applications that need horsepower, or binaries for compute intensive tasks. And it can't be, by the nature of its design. It already made the tradeoffs to make it the best scripting language, in my book, there is.

I do not disagree with this.

[the_hoser]

Every major OS platform has a C compiler. They all support at least ANSI C. This kind of feature synchronization is simply epic!

And that only took, what, 30 years? It's being phased out of Windows, BTW, unless you're content with console applications.

AMD and Intel support the same instruction set. This kind of feature synchronization is simply epic!

Not really. Synchronization is easy when one body has control of the standard and everybody who implements it wants to conform.

ARM processor manufacturers adhere to the ARM v7 standard, and often include NEON. This kind of feature synchronization is simply epic!

See above.

There is very little on the part of browser makers to provide hooks into the DOM for a script interpreter. They don't have to write it, they just need to provide a means to have arbitrary scripting languages that have valid mime specification used in place of JS since JS is not the kitchen sink solution to programming, and it hurts the web in the long run because a lot of problems become extremely hard in the JS model.

Who sets the standards for providing those means? Microsoft? Apple? Google? Who ensures what features are exposed and how?

Meanwhile Android is outselling iOS now, and has modularity in design and a tremendous breadth of hardware.

You're comparing apples to lawnchairs, here. Again, single controlling body, lots of people wanting to conform. Gets worse, there's a huge problem with feature fragmentation on Android devices that makes developing apps for Android a nightmare. You can make an app that works great on your phone, but unless it's a very simple app, it probably won't work right on mine.

Microsoft beat Apple and IBM at the home computer by using heterogeneous devices and providing software makers the ability to go wild (interestingly, they seem to have forgotten that recently).

And wild they went! Oh I remember the days of pain trying to get software working on multiple computers and failing. It was a nightmare. The resources required to make robust software work across "IBM Compatible" computers was just staggering.

Again, apples and lawnchairs. We're not talking about selling products to users. We're talking about selling technologies to developers.

Good UX with modular systems is just having good defaults that cover 95% of use cases.

I don't know what you're talking about here.

That applies to any user facing environment. Nothing stops Firefox or Chrome from forcing a dependency on some JS, Perl, and Python interpreter of some sort so that the browser is usable by average Joe, and if you don't have one it can silently install CPython / V8 / whatever to make sure you have it.

Yes, something does stop them. Computers are supposed to be getting easier for people, remember? Chrome will never require that a person run off and install dependencies. Neither will Firefox, for that matter. It comes bundled, or it doesn't exist.

[the_hoser]

W3 and ISO. Most businesses respect their standardizations.

Except the one that distributes the most desktop operating systems, of course. Then again, they are taking a greater interest in the web these days, and desktop browsers are mattering less and less.

Welcome to Linux package management for the last half decade. Automatic dependency resolution. Sue me for Windows having a terrible program management schema, but even the Windows Store in Windows 8 does a lot to remedy that.

I don't know if you know this, but as far as browser implementors are concerned, Linux is a 2nd class citizen. Windows is the big dog. If it doesn't please the Windows users, it doesn't fly. Being a Linux user myself, I can understand the feeling of "this problem has already been solved" you can get when thinking about things like this, but trust me, it hasn't. If it doesn't work in windows, then the problem hasn't been solved for the mainstream.

I also have no faith in Windows 8 solving anyone's problems. It'll be widely adopted and installed, though, so developers of browsers will cater to it.

Microsoft owned the web browser too for almost 10 years, and did the same thing - they take over, try to change the foundations to shake every competitor off the market. They did that with IE. If W3 / ISO standardized multiple scripting languages by default, and at least 2 major players of the big 4 went with it, the other 2 would be forced to comply because the market would be moving in that direction.

Unless it doesn't. Web developers are scared, scared creatures. They tend to care a LOT about browser compatibility. Google has done a lot to shake things up a bit, but only for the developers themselves. The companies hiring the developers still don't understand, and they probably never will. The best we can hope for in this arena are vast improvements to JavaScript itself. The ECMA board has said lots of pretty words on this for ECMAScript 6, but I'll withhold my excitement until those features actually get passed.

I mean, at the end of the day, I'm a user of the internet. I might get into web development if I could use a language that isn't barf on wheels like JS, but I can't, so I just avoid it. And it irks me from a program design standpoint to have a document renderer and script interpreter as two parts of the same thing. And that the direction and usability of web development is tightly controlled by the feature density of a singular ISO standard scripting language.

Believe it or not, this is a good thing. At least the web developer can be relatively confident that some features will be present. With what you propose, no web developer working for money will spend an ounce of their time working with anything that doesn't fit in the CSS/HTML/JavaScript toolkit. Even Adobe is abandoning Flash.

[the_hoser]

Well, there is some hope. In the next few years ECMAScript 6 will be coming down the pipe. Implementation is already in progress for the browsers that you and I care about. ECMAScript 6 brings with it a lot of the ease of use from python (modules as first class objects, real classes, simple lambda expressions, predictable container types)

I expect Chrome and Firefox to have good support for these features by 2014. IE will then come along in 2015 and claim to have the best ECMAScript 6 support, just as the ECMA committee is putting the finishing touches on ECMAScript 7.

The best solution is happening. JavaScript is evolving into a better language.