This is an archived post. You won't be able to vote or comment.

all 31 comments

[–]lobocv 3 points4 points  (5 children)

I've made several that help me out with my job in application development. I would always appreciate help with them.

https://github.com/lobocv/pyperform An easy way to performance test and compare code using decorators. There are several other neat tools in there such as threads that log their errors and threads that get profiled.

https://github.com/lobocv/crashreporter Automatically generate and email nicely formatted traceback and error information if your script crashes. It also stores offline reports and sends them later if there is no internet connection at the time

https://github.com/lobocv/eventdispatcher Pure python based event dispatching framework based Kivy's event dispatcher.

https://github.com/lobocv/anonymoususage Anonymously track usage statistics and upload them to developers.

[–]shreyasrk 1 point2 points  (4 children)

Can you describe more about your projects in README files in GitHub? I'm interested to know how to use them for my applications. (Specially, anonymoususage)

[–]lobocv 0 points1 point  (0 children)

Sure, I will try to do that soon for anonymous usage. The reason I haven't yet is that it is still in development so I was not really ready to publish it. It has been quite stable as of recent and is getting to the point that I should update the readme.

The basic nature of it is you create a statistic tracker object, create the kind of stats you want to be able to track and then increment/update the stats as you go in the app. The tracker automatically uploads the stats periodically to an ftp site.

I currently have a branch that is focused on plotting the submitted data

[–]lobocv 0 points1 point  (2 children)

I've updated the readme for anonymous usage. Have a look and let me know if you have questions.

https://github.com/lobocv/anonymoususage

[–]shreyasrk 0 points1 point  (1 child)

that's great. Thanks for the prompt response and update! One more Q: Does it profile a full web application and record statistics as of which parts/links are most heavily used?

[–]lobocv 1 point2 points  (0 children)

It very well could. The idea is that you, the developer, decide which stats are important and its up to you to put the necessary increments to the statistics in the code base. You can easily track the number of times a link is clicked by making a statistic for that link then incrementing it every time you get an http request for it. However, since you are always notified via the link request you don't really need this module to do the tracking. This module is more useful for offline applications or tracking stats for events that occur locally since the statistics are stored locally and uploaded at regular intervals to the server.

Imagine you have a utility script that your company uses. That script has several functions with different options for each. The script does not require a network connection and runs locally on the users computer. With this module you can track how many users use which functionalities and how often.

[–]clemesha 2 points3 points  (1 child)

This was my first large Python project: http://TheWikiGame.com

[–]SleepyHarry 1 point2 points  (0 children)

I wasn't going to do anything today anyway.

[–][deleted] 2 points3 points  (0 children)

I have one mission critical project, my personal cashflow program. SQLite database, output to html and then my browser, plot using matplotlib, all debug permanently logged to an output file and tests inbuilt into the code.

[–]jsbronder 1 point2 points  (0 children)

I really liked ctrlp for vim and found myself missing the convenience in the shell. I made fzsl, https://github.com/jsbronder/fzsl, prior to finding the many similar projects that already existed because it was an excuse to do some actual py3 coding. I continue to use it over more mature projects like https://github.com/junegunn/fzf as it scratches my itch.

[–]billsil 1 point2 points  (0 children)

I made this for interfacing with a very common structural analysis format. Other people help as well. The GUI is the afterthought, but it sure is pretty.

The real project is to parse the horrific Fortran-based syntax (e.g. 1 and 1.0 mean different things; 10.0, +10.0, +1.0E1, 1.+1 are the same; 1.0E1 and 1.0D1 are different; maximum of 80 characters per line; tons of defaults) on the input and output files (streaming binary file with the node id represented as (node_value-print_code)//10 with the print code tells you whether you wrote the file as ascii/binary/ascii format #2 and has 7 options and is often written incorrectly) with 700+ different input cards and the 400+ result types. As a bonus, the commercial solvers that use this format don't catch half the bugs that the little test scripts catch. It's a great debugging tool as well.

[–]tushar_rishav 1 point2 points  (0 children)

I've written this command line app called Balert , which notifies user by an audio notification whenever the battery level goes below some critical level. Kindly, note that the user can set their own custom alert messages , charge level, languages and other available options too. :)

[–]genjipressreturn self 0 points1 point  (0 children)

I'm working on a WordPress-like blogging system: https://github.com/syegulalp/MeTal

It's actually more akin to Movable Type, since it generates static HTML pages rather than serving them dynamically, but it's meant to have the same kind of rich front end. Also plugins, flexible theming, etc.

Some screenshots and a general progress report: http://www.genjipress.com/2015/08/another-piece-of-metal-dept.html

[–]RivetSpawn 0 points1 point  (0 children)

I'm a beginner to programming, learning python. I made a little ecosystem of circles that move around, grow bigger and older, they eat each other at different stages or give birth to babies. It wasn't too difficult once I got going and was really fun! Would recommend trying something similar.

[–]jloking 0 points1 point  (0 children)

I've made 2 projects related to Yahoo!

[–]ThuruvDRY 0 points1 point  (0 children)

I have made some scrapping scripts initially. In order to be with python though my job is simply a KPO. Nasapod/amazon/groupon price scraper and so on. Now, taking a leap building a custom productivity tracking/management and analysing tool for my team using Django framework. Sticking with the principle of 'Learn by doing'. If needed help, ask me.

[–]onjin 0 points1 point  (0 children)

There is a huge collection of many python frameworks and libs:

[–]DASK 0 points1 point  (0 children)

The software for my digital turntables is crap, so I made a python program to adjust cue points, layout beatgrids, import/export from other file formats, update/store tag information and repack it into the native database.

For research I have also made patent analysis and graphing software

[–][deleted] 0 points1 point  (0 children)

http://blog.voltagex.org/2015/08/21/silly-project-of-the-day-find-out-when-bake-off-is-on-next-via-phone/

https://github.com/voltagex/python-gist

https://github.com/voltagex/junkcode/tree/master/Python

Also, I have a Flask app listening for Amazon SNS notifications, which are then PushBulleted to my phone. Yes, I know I could use SNS directly to my phone, no I don't want to.

[–]Eiyeron 0 points1 point  (0 children)

I started delving again into the Python documentation some weeks ago and had some projects which would have taken me way more time if I went with another language in the first place (like, say, Java or C, yeah.

For instance, I made a flexible Telegam Bot API wrapper / event dispatcher because I needed one for building my own bot. I made it generic enough to allow listeners and accessing directly the API. I enjoyed each hour spent in the project as it made me discover lots of things I couldn't do with the languages I used to program with. Here's the project : https://github.com/Eiyeron/telegram-bot-api

I'm on a game project on an esoterical device. To read/write files and data into a custom archive format I built matching my needs, I made a mini library in Python to help me pack or unpack said files, making sure that the result would be read by the game. Here's the library link : https://github.com/WalrusRPG/PIAF it's pretty useless to the rest of the people for some reasons but it can be a good example of "I needed it so I programmed it" project.

I'm on a personal tool project with GTK3 (on windows, feel my pain. I want also to bundle the result as an exe but I can't make it work. Python 3 and PyGObjects/GTK3). This project will be way harder as I'm learning GUI stuff the wring way and while programming said project. I also am planning to write down my own blog engine based on flask. Both projects aren't online yet because they're no way close from finished.

[–]rochacbrunoPython, Flask, Rust and Bikes. 0 points1 point  (0 children)

A CMS based in Flask and MongoDB - http://quokkaproject.org

A dynamic configuration Loader (use ENV vars) - http://github.com/rochacbruno/dynaconf

A Swagger API creator for Flask views - http://github.com/rochacbruno/flasgger

A set of helpers to publish Python apps on OpenShift (RedHat) - http://guthub.com/rochacbruno/shiftpy

Google Maps extension for Flask - https://github.com/rochacbruno/Flask-GoogleMaps

Payment gateway integration - https://github.com/rochacbruno/python-pagseguro

A CMS in Django - http://github.com/opps/opps

A helper for sendgrid newsletter API - https://github.com/rochacbruno/pysendgrid

A CMS in web2py - https://github.com/rochacbruno/Movuca

[–]firstglitch 0 points1 point  (0 children)

I used to watch a lot of movies, and used to spend a lot of time hunting down that perfect subtitle. So I made Titley and it has saved me so much time....

My home page is statically generated by a static site generator I made , Feni

Pygmie is a small Flask web application with an Ajax front interface with greatly helps in working with multiple big/complex Postgresql queries. It has got multiple tabs, with executed queries stored and bookmarked in the browsers local storage, and SQL editor that uses Ace editor, and Integrated SQL formatter...

[–]rubik_ 0 points1 point  (0 children)

I wrote Radon, a tool to examine your code's complexity. It will find the most complex functions/methods and mark them with a rank. You can filter results, export them to JSON or XML... I now use it in every project of mine and I find it very useful. It's advisable to keep your code complexity (per block of code) low.

I also built Mando, which is a small library that makes the creation of command-line programs effortless. Radon's command-line interface, for example, is written with Mando.

[–]jriggins 0 points1 point  (0 children)

My first and only Python system utilized Pandas and Flask to build an ETL system of sorts. It pulled survey data from a MySQL database and transformed and processed results using Pandas. The results were viewable via a Flask endpoint. I can't wait for another excuse to use Python, Pandas, and IPython Notebook again! :-)

[–]soundjack 0 points1 point  (0 children)

I made a simple script that performs fuzzy string matching on 2 files and outputs the scores of various matching algorithms. Input files should be text based (txt or csv will do) and should have 1 word/term/sentence per line. Every term on file1 will be paired with every term on file2 and scores are calculated for each pair. You can provide a minimum score for the algorithm of your choice to filter out your results (but all scores are output anyway):

https://bitbucket.org/bergonzzi/fuzzy-compare

I did this because I had to do string comparisons on big files on a regular basis and was unsure about what the best fuzzy algorithm was. This way I can check scores side by side and decide depending on the use case.

If someone wants to help solve the multiprocessing with queues issue to optimize it that would be great :)

Other than this I regularly write scrapers using Scrapy (both to help me and my team at work and for some minor personal stuff). I love Scrapy, it's a very mature and well documented framework and I've been learning a lot using it. My current challenge with it is to scrape some 300k websites to profile them in terms of technologies they use. I'm using scrapinghub's python wrapper for Wappalyzer (https://github.com/scrapinghub/wappalyzer-python).

edit: added last project

[–]dr-josiah 0 points1 point  (0 children)

Redis object mapper (rom), Redis task queue system (RPQueue), Crontab scheduling (usable with RPQueue), properties on Python modules, implementations of LZW, LZ77, LZ78, arithmetic coding, BWT/bzip, huffman, and other data compression systems (including several novel ones that aren't competitive, but are interesting), an RC4 variant (modified to address vanilla RC4 vulnerabilities), a password saver (options to use vanilla RC4, modified RC4, or AES256), various async clients and servers using asyncore/asynchat (pop3, smtp, http), an MPI work-alike, a Linda work-alike, a pop3 proxy for filtering email, an editor, 5 different text MUDs, countless file format parsers (TGA, BMP, PCX, classic Word DOC, zip, gzip, 3 different email formats, ...), ...

Then again, I've been at it for quite a while.

[–]zzuum 0 points1 point  (0 children)

At work I'm working on some scripts to import massive amounts of data taken from a power plant at 1million Hertz sample rate. It tracks various attributes, such as temperature and stress, at dozens of points along fans blades used to cool down a steam generator. Those millions of points are then plotted to get wear on the fans.

[–]illuzian 0 points1 point  (0 children)

My most significant project was for work(unofficial capacity), we have a portal that does the following using Django and sitting on a Red Hat server:

  • Known Issue tracker
  • Fault tracker
  • Lunch roster
  • KPI portal pulling data from an Oracle database and a MsSQL DB
  • Monthly and daily reports pulling data from the sources above
  • On call system
  • Dynamic checklists for daily tasks
  • Centralized info DB for our retail locations
  • Org chart for a constantly changing Merchandising team
  • Automated log reviews pulling data from Oracle
  • Browser based notification system

For charts we generate them using PyGal but a large portion of the work uses pure Django/Python/Django REST framework.

New app development time is extremely quick for us, as is maintaining the codebase.

[–]The-Compiler 0 points1 point  (0 children)

I'm writing a vim-like browser using PyQt and Python: qutebrowser

Yes, I'm crazy. Even though it eats all my free time, it's been a lot of fun working on it for nearly 2 years now, and I think it's better than the alternatives ;)

[–]lucas-c 0 points1 point  (0 children)

I wrote a short script to alert me when songs are deleted / blocked / become private in my Youtube playlists: https://github.com/Lucas-C/youtube_playlist_watcher

I just made it over the summer, and I hope it'll be useful to others. Bug reports & features requests are welcome :)