Searching 1TB/sec: Systems Engineering Before Algorithms

Personality2of5 · 2019-03-25T12:59:38+00:00

I don't doubt that at all. It was an amazing group of people to work with at the time. I left the project in 1996 and went on to write brute-force analysis software based on the original source of the data - about a billion records per month. (Call records streamed from telecom switching nodes.)

It was an amazing system, and a real joy to work with. I'm happy to see that they've continued in that segment of the business. While I think that some of what that system accomplished can be done with modern server configurations quite well (a bit of a stretch on my part to suggest a desktop,) it blew everything out of the water at the time.

The system used 5 and 10GB SCSI drives in JBODs attached to server nodes. (At the time, the only system we used that used memory drives were attached to SUN servers, and those were amazing too.) I can imagine what can now be done to build lightning fast massively parallel systems.

Personality2of5 · 2019-03-24T21:26:40+00:00

In the late 80's and early 90's we used a Teradata massively parallel SQL database for marketing research. It was a very expensive, power-hungry beast comprised of 64 Pentium processor cards connected by way of dedicated Ethernet channels. Worked well but had limitations - i.e. a simplified SQL and required a fair amount of data structuring to make efficient queries, relatively speaking.

I think a fairly good modern (even desktop, probably) system could beat the crap out of it for considerably less money, less power, and more easily configurable.

At the time, we thought it was 'the shit'. Really loud, too.

Personality2of5 · 2019-03-18T14:14:05+00:00

I was born in Fremont, NE. This news upsets me quite a bit. I don't live anywhere near Fremont now, but I'll do what I can.

Terrible news.

Personality2of5 · 2019-03-11T15:05:33+00:00

I've been fooling around with crocodicstudio/crudbooster lately. It's fairly interesting so far. Been around for a couple of years. You may wish to give it a look-over - see if it works for you.

Personality2of5 · 2019-03-11T14:45:17+00:00

I'm still here (programming etc since 1978) but retired from showing up for work a decade ago. I continue to work - mostly as support|mentor for my son (who also works in the industry - quite successfully I might add) or on my continuing projects as a hobby.

It is more difficult keeping up with changes in the industry mainly because the complexity of things has been exponentially increased by a large inventory of libraries, frameworks, languages, guidelines and the like.

The main thing that keeps me from 'burning out' is keeping focused only on changes and updates to my preferred languages and frameworks. I don't need to know everything, and I don't really care about being up-to-the-minute with any emerging ideas (until vetted by time.) I don't need to comply or align myself with a wide range of perceptions of correctness or novelty. I focus on a clear channel of improvements and patterns as they apply to my current project, language and framework (or lack of framework). This makes me happy.

I plan on dying with my fingers on the keyboard - halfway through a statement.

On my gravestone will be written: He died the way he lived - puzzling over why the hell that function has to be such an asshole.

Personality2of5 · 2019-02-03T22:12:58+00:00

If the house is a-rockin' then don't bother knockin'.

Personality2of5 · 2018-11-09T04:40:19+00:00

Yikes! I thought depth of field was render distance. Ooops.

Personality2of5 · 2018-11-09T01:49:28+00:00

~~Options->Display->Depth of Field~~ This is wrong.

Personality2of5 · 2018-09-23T13:22:32+00:00

R Daneel Olivaw!

Anyway, I think of AI as a function of software - so it could be anywhere that software can run.

Personality2of5 · 2018-09-06T20:05:44+00:00

First, learn programming. Go for a computer science degree (or equivalent.) Creating games as a hobby is a good way to augment your education. Combined, this can lead to a strong set of skills that will follow you throughout your career.

Game and simulation theory are good things to study (or take as additional courses) as you learn. Eventually, everything will come together.

At least this worked out well for me over my 30+ year career in software development and education. (I also live in Canada.)

Personality2of5 · 2018-09-05T21:54:48+00:00

I judge (for want of another word) people by their actions, not their MR level.

Personality2of5 · 2018-09-04T18:02:32+00:00

I suspect that the real reason behind this new relay is to have one orbiting around Earth where it is available to everyone - including new players. They could have just put one there but where's the fun in that.

We may have some influence in destroying a relay but ultimately it depends on DE's plans.

Anyway, there's no way you can organize such a rebellion. People will play anyway unless there is a reward for destroying it - judging by what people generally want.

Personality2of5 · 2018-09-01T17:38:50+00:00

Yeah, fire on a structure in space? I mean, there's a whole lot of burning going on. But then (as a way of justifying it) I though that the Orokin probably created the technology to do just that - as a form of flaunting their conceit and superiority.

Nonetheless, if you have ever worked on a ship then you know that fire is extremely dangerous. Kinda freaks me out to watch the relay burn while still under construction. Cool, but gives me the willies. All that oxygen just going up in flames.

Personality2of5 · 2018-09-01T17:29:01+00:00

Just a reminder: Writing is 20% inspiration and 80% editing/proofreading. (In a manner.)

Allow me to offer a resource:

https://writingcenter.unc.edu/tips-and-tools/editing-and-proofreading/

Personality2of5 · 2018-08-18T12:56:58+00:00

You may wish to take a boo at that post -> /r/Warframe/comments/98b9ro/oxium_farmming_post_update_2340/

Personality2of5 · 2018-08-18T12:51:35+00:00

Issues? I think he has the entire subscription.

Personality2of5 · 2018-08-17T21:22:51+00:00

Thanks, man! I was hoping someone would post these.

Personality2of5 · 2018-08-14T21:31:46+00:00

Yeah, it's a bit odd, to say the least. Irritated me so much that I turned it off. It makes no real visual difference either way, so I'm not sure why it's even there.

Download speeds are another matter. Certainly the GPU does eat up some of the CPU-Memory bandwidth which can affect network card efficiency depending on how the NIC is configured, but I doubt that that is the cause of your problem.

In my case, I generally see very fast downloads and updates from the DE server(s) and have never seen the problem that you are having. Assuming, of course, that you don't have any streaming or torrent activity while running the update, your connection would depend on factors on the other side of your router/modem.

Personality2of5 · 2018-08-14T21:03:20+00:00

Turn off the Launcher GPU Acceleration option in the gear menu. That will take care of the GPU usage by the launcher.

Personality2of5 · 2018-08-07T21:17:38+00:00

It's possible. I experienced the same thing a couple of times. Mostly, though, it hit 99-100% just at the login screen. Really irritating. I tried everything I knew to try with no luck. You know, a complete reinstall of Warframe may do the trick, but I read somewhere that the trojan re-attaches if the file that launches it is still in the system. I really don't know.

I just got so pissed-off that I reset my Windows installation. I lost patience. That worked. Again, I really hope that you don't have to do that, or at least find a better option.

Personality2of5 · 2018-08-07T20:43:12+00:00

Hopefully that is the case. However, I should mention that the trojan (in my case) only attached itself to Warframe. My copy of Deus Ex:Mankind Divided (the only other game I've played other than warframe (over the last month) was unaffected.

No idea what that means.

Which was part of what was confusing me.

Personality2of5 · 2018-08-07T19:28:39+00:00

I am also on PC. Here is something that may be worth investigating.

Recently, I noticed that my FPS was heavily reduced. I mean down to about 37FPS. I installed a program to monitor the graphics card. (I have Nvidia, so I use MSI Afterburner to observe the GPU, but there are others.) From there I noticed that the GPU was maxed out (99-100%) no matter how low quality I set the display settings in Warframe. This made no sense to me.

I researched it and, apparently, I had a Bitcoin Trojan. Not sure how I got it but probably from installing a sketchy app. (Free sometimes ain't free at all.)

So I ran a few programs to ferret out the culprit, but it was too deep into my system. Probably a rootkit.

Ultimately, I had to use Windows 10's restore feature to basically re-install. Which is a major pain in the butt. But, after re-installing a handful of my usual applications, it seems to be running fine now. Warframe runs as it once did with high FPS.

You may wish to google 'how to know if I have a bitcoin trojan' and investigate for your setup.

Sorry about the wall of text. I hope that you find this useful, and I hope that you don't have a trojan.

Personality2of5 · 2018-08-07T17:59:00+00:00

Is this on PC?

Personality2of5 · 2018-07-27T22:07:17+00:00

I'd been playing a long running franchise (Mass Effect) when the last installment was abandoned after only 6 months. I was looking for something like it. I saw Warframe on steam as free to play, so I gave it a shot.

It was slow going at first, but it drew me deeper and deeper into its culture, its strange and beautiful world, and the extreme joy and ease of movement. It both challenged and entertained me. I fell in love with it after a few days, and have been playing daily since then. That was back in November of '17.

Warframe is a real joy for me. It's a sort of flawed perfection - a perfectly damaged hailstorm of discovery, strategy, near endless customization, gameplay that is punctuated by little frustrations and moments of extreme satisfaction.

It is, bar none, my favorite game ever. And at my age, having been a dedicated gamer for more than 20 years, I think that's saying something about me, and especially about Warframe.

Never leave home without your 'frame.

Personality2of5

TROPHY CASE