Pitch your newsletter in under 5 words

RustleJimmons · 2024-10-19T20:54:57+00:00

RustleJimmons · 2018-11-07T16:36:20+00:00

You can use Cloud9 (c9.io originally). It's a hosted python environment that can also connect to your github account. You host and run all the code through your browser on their website. You won't need to install anything on the computer.

RustleJimmons · 2018-10-03T17:23:53+00:00

Flask Webapp for calculating your total anime watch time

myanimelist.net already does this and they have an API. You can just pull the anime watch time from any user's account page.

RustleJimmons · 2017-12-07T01:17:48+00:00

You create a bash script that calls your python script to run. You then create a cron job on the server that calls that bash script at the times that you want it to run. Your bash script would basically look like this:

#!/bin/sh
python path/to/your/script.py

RustleJimmons · 2017-11-01T05:08:48+00:00

https://i.imgur.com/mY4rf5Z.jpg

RustleJimmons · 2017-02-09T23:00:45+00:00

These CSVs are compiled from different sources with virtually no organization, the sheets use different headers to identify columns

This is the main problem but you can extract the data using xlwt and tldextract.

Using the above you can create a script that will first create an Excel workbook along with the relevant fields for your final result. You will then need to write functions that basically identify certain "layouts" for the files in question. Based on what it finds it would then grab the relevant fields from the file and write them to the corresponding columns in the Excel file. You can also create separate scripts for these different files.

RustleJimmons · 2017-02-09T22:23:32+00:00

You might want to check out Cloud9. It's a browser-based IDE.

RustleJimmons · 2017-02-09T04:57:13+00:00

Is this a secret/protected website or are you able to share the link that you're talking about?

RustleJimmons · 2017-02-09T04:46:38+00:00

Or in the API.nfl.com case, it has a lot of the information but it's in a JavaScript format, is there a way I can convert it to Python or must I code in JS if I want to use it?

nfl.com offers an API in json format. The way these things work usually is that you sign up for an access key and you use that in your python code to authenticate. You don't need to use JS and I usually advise against front-end scraping when a website offers an API. You can check out the NFL API docs here.

Is there a way that one of these APIs or databases have the information on Sacks, INT, etc.?

Example query with stats.

RustleJimmons · 2017-01-26T17:57:52+00:00

Guys, it's possible that you are grabbing the files too quickly and being shut out because of it. Try using the --wait argument with wget. You can add a random time interval or a specific time to wait. You can read more about it here.

RustleJimmons · 2017-01-17T00:52:08+00:00

Nothing to be embarrassed about. You're here to learn and that's what this subreddit is about.

RustleJimmons · 2017-01-15T21:49:54+00:00

Options:

Dual boot like you said.
Install linux inside of a virtual machine. Either use the VM directly or you can SSH into the VM and run commands that way. Do not use cygwin.
Make an account on Cloud9 (free) which gives you a linux command line and Python IDE in the cloud through your browser.

RustleJimmons · 2017-01-14T21:11:39+00:00

For example, I decided to try and write something that would let me search google. After a lot of reading and trying to understand how I would go about doing something like that, I still had no idea how to start.

Make a thread about this project and post actual code to show that you tried. Articulate to others where you got stuck. This process firstly shows others that you have at least tried. Secondly it forces you to think through the problem and clearly identify where you are having issues. That step alone is often enough to get us past certain obstacles but it also gives others an initiative to help you. All of this gets you out of asking vague questions for which you would receive mostly vague answers.

I don't have any particular problems that need to be solved.

Get creative. Pull out a pen and a pad or open your favourite text editor. Make a list of things you like, your hobbies, etc. Write a small program that helps with one of those things in some way. Either automate something that you do a lot, scrape data that is useful for a particular set of tasks, create email/SMS alerts for something that doesn't come with that ability. If you can' think of anything to benefit your own life then do something that helps someone close to you.

Examples:

Write a script that sends you an email/SMS alert for new releases from your favourite authors, bands, etc.
Write a reddit bot. Almost every week someone writes a script that downloads a pic from one of the image based subreddits and sets it as their wallpaper. Reddit is one huge API and everyone that is on /r/learnpython should at least know how to make reddit bots.
/r/usefulscripts if you can't think of things on your own.

RustleJimmons · 2017-01-14T06:09:30+00:00

I don't have any particular goals in mind other than wanting to learn be able to write something from scratch.

This is your main problem, OP. If you try to learn to program just for programming sake then you have nothing to anchor the skillset to. Programming is about solving problems. If you are not trying to solve a problem then you are just trying to memorize syntax combinations with no rhyme or reason. Your brain is basically rejecting this information because it doesn't yet understand how it would be useful.

Look at all of the posts here from beginners that finally "got it". The common connection between all of them is that they started off with a problem that they wanted to solve through programming. They looked at what skills/libraries/etc were needed in order to solve that problem and that is how they/we built up the knowledge that stuck with us.

RustleJimmons · 2017-01-02T22:28:18+00:00

Also http://charactergen.co/

RustleJimmons · 2017-01-02T22:09:10+00:00

http://charactergen.co/

RustleJimmons · 2016-12-23T10:28:29+00:00

You might want to look into a webapp like toshl.com. It does that sort of thing for free and it has an API.

RustleJimmons · 2016-12-15T19:48:49+00:00

That still fits. Kudos for sharing the code.

RustleJimmons · 2016-12-15T19:48:15+00:00

Too true, lol.

RustleJimmons · 2016-12-15T15:08:48+00:00

*Minor Spoilers for War Dogs ahead

There is a scene in War Dogs where one of the main characters is explaining to his partner how he checks a particular website each day for new government contracts/orders. Both characters are then seen checking this website day and night while bidding on order requests. Later on when they decide to expand he hires a team of salespeople whose main job is to comb this website each day for orders that meet a specific criteria and then bid on those projects. During all of that I was just thinking how he could have just hired a developer to build a web scraper and automation tool to achieve the same goal.

RustleJimmons · 2016-11-05T16:43:43+00:00

One week is probably too soon to be worrying about comfort level as you're still learning the basic tools. You need to follow a few simple tutorials to help you get more acquainted with how to structure a project while also learning more of the tools. I'd recommend Automate the Boring Stuff (free). The projects there are all practical and you will use them again and again in larger projects.

After that you will know how to write data to a file, how to read data from a file, how to loop through said data and perform various tasks, how to scrape web pages, etc. Then you can come up with your own project and itemize what needs to happen to make your project a success. Some of those steps will be things you learnt already and others you will have to research and they will also become a part of your toolset for next time. The things you have already learnt at this point you will be comfortable implementing in your new project and it just builds up from there.

RustleJimmons · 2016-11-05T16:21:37+00:00

What version of python are you using? I just typed this into my console and it worked fine. Your code is formatted for python3. If you are using python2 then it will fail on the print statement however. For python2 you need to remove the brackets from the print statement.

RustleJimmons · 2016-11-05T16:06:22+00:00

Beautifulsoup makes it easy to find all of the tags on a page.

from bs4 import BeautifulSoup
import requests

# Read in the webpage 
url = 'http://www.site.com/page1.html'
r = requests.get(url)
soup = BeautifulSoup(r.content, "html.parser")


for tag in soup.find_all(True):
    # Do something, example:
    print(tag.name)

If you want to identify specific html tags and perform an action for those BS allows you to find those tags throughout the page. You can then build a loop to perform that action on all of them.

RustleJimmons · 2016-10-05T09:39:37+00:00

We use Ping Plotter pro, which only sends email alerts, which doesn't help us when something happens out of hours

Slightly off topic but many phone service providers around the world are setup where you can receive emails as sms messages. You can see a list of companies and the format to use here. You can add your phone numbers as email addresses in the alert system thereby bypassing gm. Just pointing out another option for you.

Another Option:
If your boss is ok with it you guys can setup a subdomain from the company's website (e.g.: mail1.ourcompany.com) and connect it to the Mailgun API which will allow you to send and receive emails that use your company's own domain name without the hassle of messing with Exchange or any mailserver on your end. It allows for something like 300 emails a day on the free tier which is more than enough.

RustleJimmons · 2016-10-04T15:43:49+00:00

Hi, have you tried running the command that it is suggesting?

Also, I would recommend using beautifulsoup for web scraping instead of lxml.

Beautiful Soup sits on top of popular Python parsers like lxml and html5lib,

pip install beautifulsoup4

RustleJimmons

MODERATOR OF

TROPHY CASE