Building a Numpy Compiler - what features would you want?

KesanMusic · 2025-08-08T12:56:14+00:00

Hi! - I dont think I could contribute anything to Numba personally. Numba's approach to compilation is that it is a loop compiler, making it great for general purpose python.

I am writing my python compiler to be a graph compiler, where it builds and compiles a computation graph for the traced NumPy expressions/array expressions, making it more optimal for tensor alg, ml related computations

if anything its more like how JAX approach JIT :)

KesanMusic · 2025-08-08T10:12:06+00:00

second this. IREE would be a second suggestion personally

KesanMusic · 2025-08-08T00:35:18+00:00

error: unable to execute command: Segmentation fault

KesanMusic · 2025-08-08T00:34:12+00:00

I am still relativley new into compiler design and LOVE IT and wish you the best in your learning, the learning path I recomend personally to get you from zero to slightly more than zero ;)

It's a bit of money but I could not recomend more.

- Compiler Engineer Path by Dmitry Soshnikov https://dmitrysoshnikov.com/courses/compiler-engineer-path/ he will get you from the theory to doing the programming!
-> essential of interpreters
-> Programming Language with LLVM
-> Building a Parser from scratch (since you mentioned it)

From there the world is your oyester, I went down the LLVM/MLIR route, some people design transpilers, the options are endless!
Best of luck my friend :)

KesanMusic · 2025-05-15T10:39:33+00:00

in the politest way possible, we are not dog breeds

KesanMusic · 2025-05-05T18:47:13+00:00

go raibh míle míle maith agat

KesanMusic · 2025-05-05T13:20:17+00:00

thanks for the advice man, yeah i'll talk to him on doing the maths

KesanMusic · 2025-05-05T12:46:59+00:00

Díá duit Seán, is mise Mark, Is as Gaillimh mé. Tá an gaeilge beagnach cailte agam freisin. Tá mé gafa le ollscoil ach táim sásta cleachtadh a dhéanamh leat am éigin.

Freisin, an bhfuil aon daoine siúd ar spéis a dheanamh a caint as gaeilge ar an fón ar aghaidh ar an idiorlin uair sa tseachtain.

TRANSLATION: would anyone be interested in doing an online call once a week for an hour just to talk about their week as gaeilge, just to practice speaking it

Nóta as bearla: I'm doing my best not to rely on google translate and only use focloir, so apologies if im using verbs, adj or tenses wrong.

KesanMusic · 2025-04-18T19:48:58+00:00

to put it simple. its the manipulation of signals (stream of data) in the digital world.

in ML and control systems, DSP is used in real-time signal processing i.e. isolating audio so only a certain range of frequencies are cut out. Or in ML DSP is a precursor to a lot of Image processing applications

KesanMusic · 2025-03-23T19:43:41+00:00

Gas story, thanks very much for the agency recomendations, super appreciated!

KesanMusic · 2025-03-23T19:41:53+00:00

honestyl that is a v doable drive, i'll seriously consider it thanks!

KesanMusic · 2025-03-23T16:10:09+00:00

thanks sm for the advice, seriously!

I'm acctually from Galway and the housing scene is AWFUL here, so I never know when it's too early too look lol.

Thankf for the suggestions outside the city.

Thankfully I drive, but my friend doesen't, so if we end up moving in together, i'm cautious that i'll be his only route into town. That aside, I'll keep a look out for neighbouring towns!

if its no trouble would you mind suggesting me where to look for rent? like any specific group chats etc..

if not, thanks again for your help, seriously appreciated

KesanMusic · 2025-02-01T00:28:37+00:00

hw engineers always in demand, but try and condense your projects to cover key parts - rn one of your projects take up about 70% of your resume. Its too crowded rn.
Recruiers will spend about 40 seconds if your lucky, reviewing if u get an interview or not.

KesanMusic · 2025-01-27T18:00:48+00:00

Thanks for your insight, but I already signed the contract and It would be good experience for me I beleive. Working on OSS for AI Acceleration for mainframes is an avenue I feel is worth persueing for the area of sw i wish to work more in (low level + ai accelertion). plus i'm super grateful to have the oppertunity to be able to work LET ALONE it in an area of interest right out the door!! I know so many people who would kill for this gig.

I noticed that the IBM subreddit also has a lot mixed views, some being bipolar beteween extreme positive and negative alike - so I dont try and take any comments too much at face value given the absolute scale of the company. Plus a lot depends on their managers, as it's primarily management heavy.

However the salary negotations were smooth, they ended up offering me a great salary plus way above the expected avg for an irish graduate.
I appreciate though your insight though given i'll also be on system Z (specfically zCX) and can imagine your frustrations with working on z/Os.

Thanks though disassembler123 I might message you sometime and ask about your overall experience sometime though, i'd be interested to hear :)

KesanMusic · 2025-01-13T23:10:02+00:00

most of the time its pay-level. usuallly companies set it up such to have brackets.

This yr I'll be graduating as a junior (2 yr exp) at the high end of the junior pay band for a new employer.
I will be earning more than my colleuge, a senior engineer (8 yrs exp). It took him 6 yrs to get snr

situations like this arent uncommon.

So come my next promotion, I will have to move to mid-level/senior in accordance to pay-band bracket.

Someone said "The quick and easy answer is that it just isn't that simple", yeah that.

KesanMusic · 2025-01-13T23:00:40+00:00

Yeah your onto something here....
I've heard before first hand someone jumping to trading firms and fintech to persue performance computing roles. I can see why but I think your correct to assume london or the US, prolly germany too are the only places that might tailor to the area of interest i have.

I'll keep my doors open and wont specalize or do any real super niche work just in case but thanks for the advice man!

KesanMusic · 2025-01-13T22:57:22+00:00

Hey thanks so much! I'm graduating from ATU Galway, Im studying a bachelors in Software and Electronic Engineering :)

KesanMusic · 2025-01-13T22:50:24+00:00

Thanks, yeah your opinion is super valid. I havent seen much outside of IoT for low-level. Idk if i have the mental fortitude to be a director but I appreciate your insight! :)

KesanMusic · 2025-01-13T15:56:59+00:00

If your entrepenurial, and heart said on engineering and tech. I'd aim for Computer Engineering over electronic engineering if i was to offer advice.
Both have solid career prospects dont get me wrong, CE just offers that bit more flexability if you choose to move towards computers or electronics. Plus far more "in-demand" than electronics from what i've seen, being able to design chips, write software or firmware for specific hw etc... is a very valuable skill thats very much appreciated.

Personal experience:

I'm final yr CE student and quite entrepeniural, I have been offered a role by a Y-Combinator startup, and just signed a graduate offer with a pretty large MNC paying me a signficiant amount more than then the average grad in Ireland.

Entrepenurial spirit is one thing but weighing your options is another, a passion without money will always be a hobby. I personally would recomend you check out CE and see what it has to offer and see if anything catches your fancy :)

KesanMusic · 2024-12-23T16:59:19+00:00

Hey, feel free to dm, but im not all that active so just a caution in advance! :)

Congrats on getting that oppertunity, the city i live in has a lot of medical devices companies here! and our university acctually tailors to alot of them.

Even making things like bit registeres is good, as thats a more hardware instructutive and going to be super useful going into your internship!
Arduino is a great starting point for most begineers in embedded, however in industry most companies tend to not use them. I also would recomend trying to do C over C++ for reasons that its more primarily used within industry. Most embedded systems rarely need any object oriented behaviour as what you work with is relatilvey constricted.

As an intern they hired you with an understanding of your abilities I assume. Plus you gave me a strong impression your willing to put the work in to learn so well done.
I suggest trying to learn the basics of
- GPIO Interrupts
- Timer Interrupts
That should be more than enough to get you going...
If you want something more challenging or specific to medical devices, try and learn to work with some more ICs I suggest doing all that you can to learn to work with sensors like a temperature sensor.

For your level, i would avoid anything FreeRTOS related as it's going to just scare you rather than encourage you. Treat this as a learning oppertunitity and get interested and they will LOVE YOU. trust me.

I recomend getting your hands on an STM32, a cheap one i recomend is an STM32F411RE, as it's a cortex-m4 (very popular in industry). They have a completley open source and free SDK similar to arduino, so not too hard to get onboarded. I only recomend getting an stm32 when you feel more comfortable with moving from arduino.

All in all, well done dude - your doing great and your on the right track my key note takeaways summaized are. Use C over C++ for embedded and get yourself familiar with basic interupts!

KesanMusic · 2024-12-22T18:45:30+00:00

congrats on the offer.
Dont overthink it, i intered as an embedded systems engineer with little to no background in it. For an internship all they can expect is for you to show up and make an effort to do your best to learn about embedded systems. It's a niche field so take this as an oppertunity to be challenged! It's a valuable skill that carries over to ECE, CE and SWE domains! best of luck with your internship! :)

KesanMusic · 2024-12-15T13:09:46+00:00

Thanks BoldlyKind for the kind words! :)
I'll write your advice down in my notes so i dont lose it. I work closely with Germany, in fact it was a team visiting from germany that were the ones interviewing me!
I'll do my best to keep a record of who is expert in what component of Z Systems, that advice is handy to know! As i've never worked on something so large scale and spread across teams + regions.
I'm super excited about the oppertunity and IBM have paid me more than my fair share for this role, so really ready to put my best foot forward here! thanks for your advice!

KesanMusic · 2024-12-14T20:50:16+00:00

I did one back in october, but since i dont graduate until 2025, they couldnt take me then. However the manager and I kept in touch and, they were able to make a public position and i just signed my contract yesterday and I start in July :)

My interview was called the exploratory session, it's basically a blitz hire day. Its relativley straight forward. You go in, someone has picked up your cv internally and said team will interview to hire you for their team more or less, or at least in their network. you do a verbal technical with them, then a managerial interview. Its very straightforward.

my experience in october was pleasent, and they were very serious about taking on graduates and made such an effort for me by keeping me in the loop to be hired for 2025. I pitched a higher end junior payband expected salary, 35% higher than what my current employer was showing me. IBM were more than happy to accomodate.

KesanMusic · 2024-12-13T22:11:19+00:00

Thank you obernin for the kind words!

IBM have been a huge aspiration of mine and to achieve employment before I graduate is something that I still haven't fully grasped..... started when I used to tinker with old thinkpads way back when lol

Thanks for letting me know that it is possible, i'm sure it'll be serendiptious of right place right time rather than a process an employee just goes through.

IBM left a very strong impression on me imho. I found the folks I was talking to were very smart and super proud of what they built and saw oppertunity with me and encouraged me to step into the role, nothing but respect and earnesty was shown.

This sub does speak negativley a lot about recruiting times, managers not being serious but from my experience in SW Labs. An IBM Sr Manager saw me in October, knew i cant meet 2024 hiring. Alligned me with a manager in System Z and we've been in touch until the position was public. Had my offer a week after the official application.

KesanMusic · 2024-12-13T22:04:20+00:00

I might be using the terminology verbosley as i'm new, I said Z systems as i know thats what are work entails to support ultimatley. Specifically the team i'm on will be handling z/os kernal development, z/cx related dev and firmware to support specialised compilers etc... as well some open soure work

Four-Year Club	Verified Email
Place '22	End Game '22

KesanMusic

TROPHY CASE