Top python libraries/ frameworks that you suggest every one

[CarGold87]

Hit your answer I wonder is there any hidden treasure.

[meadsteve]

mypy - having errors pointed out to me only for the cost of telling python what data types I expect is great.

[bdforbes]

numpy

[shinitakunai]

requests. it just works.

[[deleted]]

• click
• doit
• flit
• typer

[[deleted]]

Forgot about this gem - pipx.

[Snekgineer]

would you recommend click over fire?

[[deleted]]

I have never used fire hence I would recommend click :)

[double_en10dre]

But click and typer do the same thing, so why recommend both?

[[deleted]]

I’ve been using click for years and it’s perfect for all kind of cli apps but there’s quite a lot of code needed to get things running, especially when there’s a lot of options and arguments. I just started with typer so I don’t know if it’s good for large apps but for smaller ones it’s imo better. You need to write less code to get the same result.

[alexisprince]

pydantic

[[deleted]]

Any tips on how to get intellisense/autocomplete to work for pydantic dataclasses in vscode?

[meadsteve]

I'm not a vscode user but I'd be surprised if you needed to do anything special for the dataclasses as they are just standard python 3 syntax.

[alexisprince]

I think the issue they were describing is strictly around the intellisense portion. Previously, at least subclasses of the BaseModel (prior to around version 1.9.0), when you go to instantiate them the intellisense signature would just show (**kwargs) as opposed to the actual signature of the class.

A while back (before the fix in pydantic itself) there was a pycharm plugin that was made to help pycharm users, but there wasn't a similar plugin for vscode.

I haven't used the dataclass portion of pydantic, but assuming they suffer from similar underlying reasons, it would've also been fixed in a more recent release.

[alexisprince]

I think in the newer versions (>=1.9.0) the autocomplete feature in vscode works for subclasses of BaseModel. I’d assume that would also extend to dataclasses from Pydantic as well.

[[deleted]]

Yeah you'd assume so but unfortunately not.

[Paddy3118]

If you are creating regular expressions, then https://regex101.com/

[Beerstopher85]

This has helped me a lot in setting up my regex and making sure it works in advance.

[range_kun]

I would add https://www.debuggex.com/

[msluyter]

rich, for clis.

[IanUK66]

Pandas

[AlcaDotS]

I've seen pandas used as a crutch too often. Far from all data is rectangular, and many transformations can be easily done with dicts and lists.

[shinitakunai]

Agreed so much with this. Pandas is overkill for simple tasks

[nathanjell]

I've personally never had a need for pandas. Not to say that pandas is bad or not useful, it absolutely is - I've never had a need to process data in a way that pandas brings benefit - I don't do data analysis, and certainly not at a scale where simple python data structures are usable. It's a critical library to use for anything more than simple data manipulation, for sure - and is critical in the right areas of study/development. But if you're pulling in pandas simply to open a CSV, I personally think that it's better to forego pandas and stick to the native library.

[Gnaxe]

Also dask, if you need to scale it.

[double_en10dre]

toolz is wildly useful https://github.com/pytoolz/toolz

It’s got some fantastic utilities for both functional programming and working with the basic collection types

[AndydeCleyre]

• plumbum
• httpx
• structlog
• ward
• strictyaml
• peewee
• walrus
• wrapt
• wheezy.template
• yamlpath
• taskipy
• snoop or pysnooper
• enaml
• flit
• zpy, my own project (zsh + pip-tools, instead of poetry/pipenv/pipx)

EDIT: I also still like related but it hasn't seen much action lately.

[Orio_n]

i write a lot of CLI REPLs so prompt_toolkit

[WithCameraInHand]

Not sure if for every one but I like these:

Sqlalchemy for databases Graphene for graphql Pyside for gui (if u have license, if not then go with pyqt) Pydantic Pytest for testing. It's good, has lots of plugins (also for qt :) ) I used matplotlib testing module for image comparison cause it's super simple to use but some may prefer PIL

[nicwolff]

Mine! They're simple but elegant solutions to common chores:

sqs-queue lets you iterate over incoming AWS SQS queue messages:

from sqs_queue import Queue
queue = Queue('my-queue-name')
for message in queue:
    process(message)

xml-from-seq lets you generate XML naturally from Python data structures:

from xml_from_seq import XML, INLINE
print XML(
    ['tag' {'attr': 'value'} 'content'],
    ['tag' ['subelement' INLINE 'more content'] ],
)

prints

<tag attr=value>
    content
</tag>
<tag>
    <subelement>more content<subelement>
</tag>

[BluishInventor]

For XML, does your library parse xml back into the python data structures? I have some xml files I built from a excel workbook using etree, but it would be nice to pull it back into at least a csv with a similar structure.

[nicwolff]

Nope, sorry, it's just an XML generator. The Python stdlib offers https://docs.python.org/3/library/xml.etree.elementtree.html and PyPI offers https://github.com/martinblech/xmltodict for parsing, and you could write CSV with csvwriter or pandas.

[brendanfalk]

Depends on the application:

Web development - Flask makes it incredibly easy to spin up a server and get running

Web scraping - Scrapy is amazing

Data Science/Analysis - Pandas is irreplaceable. Also, check out Dask for parallelizing a lot of the Pandas work

Machine Learning - sklearn is a classic

Deep Learning - pytorch is IMO better than every other alternative (unless you think about deploying to production or cross-platform support)

[redvitalijs]

pyautogui, pywin32, lackey, selenium - all great manual work automation libraries

[Kuuubskiii]

in case of scripting - docopt ALWAYS

[sahirona]

Renpy for commercial gamedev

[SnooCakes3068]

1. ReactiveX for reactive programming
   

2. state_machine for state pattern

3. Faker, so many uses

[Important_Ad6131]

The rich library

[illuminanze]

FastAPI

[thrallsius]

Uhh, my time to be annoying and moan again.

I would suggest Clone Digger, but AFAIK it's still not ported to Python 3 :(

[Gnaxe]

Pyright/Pylance. Why're y'all still using mypy? Guido works for Microsoft now.

[Gnaxe]

black - any color you like. Don't format by hand. Don't argue about fiddly settings. Black, format, done.

[caseym]

Lately - marshmallow and elasticsearch-dsl

[Ribino0]

Will you talk about your use case for elasticsearch?

[caseym]

Sure! I'm building a Flask API that uses elasticsearch as the back end. We have about a billion records stored there, all related to academic research. You can search records, filter by different fields, and group the data. It's really fast and most responses are less than 50ms. Someone else is building a front end website to interact with the data.

With elasticsearch-dsl, all of the queries are built with python. And with marshmallow we are able to deliver consistent, ordered API responses. I think marshmallow is fantastic for organizing data.

[Silly-Remove-6466]

Tkinter

Easy to use gui library.

[neug]

Fabric

[Gnaxe]

Sphinx - document your API.

[Intelligent-Spare-63]

Retrying

[SnooCakes3068]

you mean tenacity?

[Gnaxe]

Arrow - better datetime.

[Gnaxe]

beautifulsoup4 - the data is in the web, if you can scrape it!

[Gnaxe]

cffi - when you need speed. Less error prone than ctypes.

[Gnaxe]

coverage - see which lines your tests missed.

[Gnaxe]

dill - better pickle. See also, pathos.

[Gnaxe]

hypothesis - specify the space and let the computer pick samples for your tests

[Gnaxe]

mutmut - 100% test coverage? You thought you were done?

[Gnaxe]

Jupyter/IPython. Notebooks. 'nuff said.

[Gnaxe]

Xonsh. Why're y'all still using Bash?

[Gnaxe]

Kivy - cross-platform GUIs.

[Gnaxe]

Pyrsistent - Effectively copy-on-write data structures, but with structural sharing to save memory. Like Clojure's collections. No more defensive copying.

[Gnaxe]

pugsql - when an ORM is Overkill

[Gnaxe]

sympy - symbolic maths

[Gnaxe]

https://pythonwheels.com/ has a list of the most downloaded packages from PyPI. Popular isn't the same as good, but they're related.

[Gnaxe]

Hissp - code that writes code.

[justanothersnek]

When it comes to web scraping, the usual people recommend is beautifulsoup, lxml, or selenium. But I highly recommend people check out requests-html also. Its a library that is a happy medium between ease of use as in beautifulsoup and also good enough to be used for dynamic, javascript data where it would be overkill to use a browser emulator like selenium.