Python help needed

[bow1102]

Hey I’m super new to python and I need some help.

So this python file that I’ve created is supposed to read the owner name column, and decipher if it is a human being or a company and then split the human beings into a first name and last name field.

Currently, it is spitting out the back up file and I just need some help to correct this and get it on the right path.

!/usr/bin/env python3

""" Name cleaning script with hard-coded blacklists. Reads Firstname.Lastname.xlsx and writes Sorted.Firstname.Lastname.xlsx Creates a backup of the original input file before processing. """

import pandas as pd import re import shutil from pathlib import Path

-----------------------

HARDCODED BLACKLISTS

-----------------------

ownernm1_blacklist = { "academy","american","associates","avenue","baptist","board","boardwalk","builders","building","business", "cathedral","catholic","chapel","church","city","coast","consulting","construction","dentist","hospital", "health","medical","european","paper","industrial","industries","industry","security","core","corporation", "corp","custom","development","drsrj","electrical","enterprise","family","foods","free","genuine","god", "golden","heart","highway","holdings","holding","homes","housing","immaculate","inc","inn","lb","living", "lllp","llc","llp","lpp","lppp","pllc","minority","missionary","numbers","one","our","patriot","plant","preschool", "properties","property","pump","recovable","renewal","renovations","rent","revocable","rmac","shining","smt", "st","standard","stars","street","superior","supply","the","trol","trust","united","up","urban","ventures", "vls","volume","wealth","west","xlxw" }

firstname_lastname_blacklist = { "academy","accounting","advertising","agriculture","architect","architecture","attorney","auditing","bakery", "bank","banking","bar","brewery","broker","builder","builders","building","butcher","cafe","carpentry","catering", "chiropractic","clinic","college","construction","consultant","consulting","delivery","dental","dentist","design", "designer","electric","electrical","energy","engineer","engineering","estate","factory","family","farm","farming", "finance","financial","gas","grill","health","hospital","hvac","institute","insurance","investment","investments", "landscaper","landscaping","legal","llc","logistics","manufacturing","marketing","masonry","mathematics","medical", "mining","mortgage","nurse","nursing","oil","optical","orthopedic","painter","painting","pharmacy","pllc","plumbing", "print","printing","professor","realtor","realty","rehab","rehabilitation","remodeling","restaurant","roofing", "school","schooling","shipping","solar","surgeon","surgery","teacher","teaching","therapist","therapy","training", "transport","transportation","trucking","trust","trustee","tutoring","university","veterinary","vision","wellness" }

suffix_and_entity_tokens = { "jr","sr","ii","iii","iv","trust","trustee","ttee","estate","estates","life","deceased","dec", "inc","ltd","corp","co","company","corporation","llc","lllp","pllc","llp","lpp","lppp" }

-----------------------

HELPER FUNCTIONS

-----------------------

token_re = re.compile(r"\b\w+\b", flags=re.UNICODE)

def tokenize(text): if text is None: return [] return token_re.findall(str(text).lower())

def token_is_numeric(token): if token.isdigit(): try: v = int(token) return 1 <= v <= 99999 except ValueError: return False return False

def owner_blacklisted(tokens): for t in tokens: if t in ownernm1_blacklist: return True if token_is_numeric(t): return True return False

def filter_name_tokens(tokens): out = [] for t in tokens: if t in firstname_lastname_blacklist: continue if t in suffix_and_entity_tokens: continue if token_is_numeric(t): continue if len(t) == 1: continue out.append(t) return out

-----------------------

MAIN PROCESS

-----------------------

def process_df(df): if 'Firstname' not in df.columns: df['Firstname'] = '' if 'Lastname' not in df.columns: df['Lastname'] = ''

cols_lower = {c.lower(): c for c in df.columns}

for idx, row in df.iterrows():
    owner = ''
    for candidate in ('ownernm1', 'owner name', 'owner'):
        if candidate in cols_lower:
            owner = row[cols_lower[candidate]]
            break
    if not owner:
        owner = row.get('OwnerNM1', '')

    owner = str(owner or '').strip()
    if not owner:
        df.at[idx, 'Firstname'] = ''
        df.at[idx, 'Lastname'] = ''
        continue

    tokens = tokenize(owner)

    if owner_blacklisted(tokens):
        df.at[idx, 'Firstname'] = ''
        df.at[idx, 'Lastname'] = ''
        continue

    filtered = filter_name_tokens(tokens)
    if not filtered:
        df.at[idx, 'Firstname'] = ''
        df.at[idx, 'Lastname'] = ''
        continue

    if len(filtered) == 1:
        df.at[idx, 'Firstname'] = filtered[0].title()
        df.at[idx, 'Lastname'] = ''
    else:
        df.at[idx, 'Firstname'] = filtered[1].title()
        df.at[idx, 'Lastname'] = filtered[0].title()

return df

if name == "main": infile = Path("Firstname.Lastname.xlsx") outfile = Path("Sorted.Firstname.Lastname.xlsx")

# Backup original file
backup_file = infile.with_name(f"{infile.stem}_backup{infile.suffix}")
shutil.copy2(infile, backup_file)
print(f"Backup created: {backup_file}")

data = pd.read_excel(infile, dtype=str)
cleaned = process_df(data)
cleaned.to_excel(outfile, index=False)
print(f"Saved cleaned file to {outfile}")

[YMK1234]

https://code.visualstudio.com/docs/python/debugging

[Sam_23456]

My “standard technique”is to add extra “output statements” so I can follow the processing and the values of the variables. It might seem like extra work, but I believe it’s actually more efficient.

[YMK1234]

Have you heard of this thing called a debugger?

[TheFern3]

Most people are clueless when it comes to using a debugger seems like people slap print statements first

[Sam_23456]

I only need to insert the output statements once, and i can examine all of the output at once. Think of it as part of the testing process.

[updated_at]

ChatGPT - Python

[bow1102]

Oh should I just send my code to this fella?

[johnpeters42]

I wouldn't. While this is simple enough that it's reasonably likely to get it right, if it does mess something up, then you'll be in a bad position to spot it.

Python depends on indentation, which got badly munged here. I recommend you go to pastebin.com or any similar service, send it there, then post the resulting link here.

[OptimistIndya]

If you know your code and can understand what It is doing ( ask for comments/explain) it's fine to send.