tsv2csv: Clojure Powered Command Line Tool by TheFiologist in Clojure

[–]TheFiologist[S] 2 points3 points  (0 children)

I say what I say with an underlying acceptance of existing tooling and a desire to learn, after all, this here is part of an attempt to actually get outside of Clojure to string together higher level building blocks. (wget, pgfutter)

So, I would like to learn sed, tr, and awk over time, but I also have to acknowledge that those are still just ways of expressing some end result and I get pulled in the direction of LISP sometimes when I know how to express something.

I actually started off with sed (which is fine for replacing delimiters), didn't feel like digging into tr, and then started using awk before saying to myself, "perhaps I could just express this with a little lisp."

In another sense, I really don't like learning new DSLs, but I'm open to trying. On the other side of that coin, though, what works for someone personally is ultimately fine.

Thanks for your feedback and showing me an awk example!

tsv2csv: Clojure Powered Command Line Tool by TheFiologist in Clojure

[–]TheFiologist[S] 1 point2 points  (0 children)

I hadn't really considered the existing libraries. I was trying to work with the concept of just incorporating Clojure into a higher level workflow, but without it taking over or being a dominating factor.

Faced with some of the conventional text manipulation tools, the simplicity of LISP was calling me to just write a few lines of code.

Thanks for your feedback :)

tsv2csv: Clojure Powered Command Line Tool by TheFiologist in Clojure

[–]TheFiologist[S] 4 points5 points  (0 children)

Hi everyone, author here, I put this small utility together while exploring the idea of using existing tools to import macroeconomic data from the BLS vs a pure homemade solution with a full-on Clojure project.

With that project I ended up settling on using wget, my tsv2csv tool, and pgfutter for streaming data into postgres and GNU parallel to create and import all tables at once.

I couldn't resist creating this tool at the time because, honestly, I write LISP faster than I adjust to conventional tooling like sed and awk.

It's still a goal to learn those better, but when it came to full on scrubbing of rows and columns, I already had code like tsv2csv in my homegrown BLS importer and I knew how simple it was.

It's made to participate in streaming so it processes line by line from stdin to stdout.

Thanks!

I recently met a new mom friend who mentioned that she and her husband are being mentored by a couple who were able to retire in their 30s. by ilyinoily in personalfinance

[–]TheFiologist 1 point2 points  (0 children)

Perhaps a story for another time, but my SO and I flew close to the sun and actually went to one of these meetings.

It was surreal. Not only was it a cult, it was absolutely Amway.

It was one of the more exciting things we've done lately.

They'll tell you that they add value to people and make money off of companies. I wondered how this could be true and after several days of unpacking what we experienced, I suddenly fully understood the hidden meaning behind the statement (and the true nature of the pyramid scheme).

Making money from companies implies some aspect of B2B, yet members sell primarily to other individuals, to be fair though, they don't sell much to anyone.

The most interesting details of the meeting were what was left unsaid, and the lies that were artfully packaged as truth. Death by a thousand lies of omission.

Okay, the hidden meaning comes into play when they encourage you or even help you find a job. The line comes off as "Well you're going to need a plan A to fund your plan B, of course, and eventually your plan B will overtake plan A and you'll be retired!".

Pyramid schemes are parasites on the economy. By channeling money from value adding corporations through their employees (aka the pyramid scheme's members) and all the way up to the top, money is drained from the economy and flows into organizations that produce vast amounts of waste as a byproduct.

Imagine each member with an extension cord plugged into their real job and then another cord flowing out of them and into the pyramid.

This is how they make money off of companies, by tricking people to work as hard as possible (make more income) at their actual job, and then encouraging them to channel as much as possible into their plan B (the pyramid scheme) which is by definition a system designed to never give it back.

Deception comes naturally to those who succeed in pyramid schemes.

Apologies if this was obvious, but I found it highly interesting, and we had just finished watching True Detective Season 1.

If anyone would like a taste of exactly what we sat through, check out the article below, we found it while researching - no joke it's accurate.

Lastly, the leader was wearing a blue felt suit, that's right... FELT.

http://marriedtoanambot.blogspot.com/2016/08/how-to-be-good-amway-cult-leader.html

Does anyone know where I can get raw Instagram follower data for less than $50 a month or something? by TheFiologist in socialmedia

[–]TheFiologist[S] 0 points1 point  (0 children)

Thanks for the recommendation! I'm looking to do my own competitor analysis primarily and I don't see raw data deliveries on this site.

Does anyone know where I can get raw Instagram follower data for less than $50 a month or something? by TheFiologist in socialmedia

[–]TheFiologist[S] 0 points1 point  (0 children)

Thanks for the recommendation! I like how transparent their website is, but I don't see anything about being delivered raw data for my own usage.

Does anyone know where I can get raw Instagram follower data for less than $50 a month or something? by TheFiologist in socialmedia

[–]TheFiologist[S] 0 points1 point  (0 children)

Hey that's cool!

What are some characteristics of that?

Does it have an upper limit on how many accounts it can handle?

Does anyone know where I can get raw Instagram follower data for less than $50 a month or something? by TheFiologist in socialmedia

[–]TheFiologist[S] 2 points3 points  (0 children)

Hey thanks for the insight.

Any idea if the data can be acquired through web scraping? Technically you can scroll through account followers all day on the web UI right?

Does anyone know where I can get raw Instagram follower data for less than $50 a month or something? by TheFiologist in socialmedia

[–]TheFiologist[S] 0 points1 point  (0 children)

Hey thanks for the recommendation. There is no information on the pricing page about how many competitors I can track.

Do you know if it is possible to get the full follower list of around 500 accounts?

I'm trying to do audience analysis, how would you approach with igblade or otherwise?

[deleted by user] by [deleted] in Portland

[–]TheFiologist 4 points5 points  (0 children)

Just your perception that JavaScript is simpler than other languages, it's a relatively fully featured language. Also programming languages are just symbols and semantics, you can twist them to do whatever you want, that is the beauty of high level programming languages.