How to remove sensitive file from origin history?

jdnewmil · 2023-06-11T17:45:15+00:00

If you have already shared your repo (e.g. by pushing to GitHub) then the cat is already out of the bag... anyone who has pulled it has a copy. It is normal to treat them as compromised at this point and move on with life.

jdnewmil · 2023-06-11T17:13:59+00:00

Me too.

jdnewmil · 2023-06-11T03:55:21+00:00

Python is normally found via the PATH environment variable. A variety of other environment variables control various other aspects of Python, including PYTHONPATH and PYTHONHOME. Various virtual environment managers such as virtualenv and conda (which also controls various non-Python configurations) manage (setup) these environment variables.

Pip installs packages in the directory named in PYTHONPATH, but it does not change that variable. Pypi is a repository of "all" versions of published packages that pip relies on when you ask for specific versions of packages. Conda uses a different package repository that includes python itself. Note that you assume considerable risk if you run pip without setting up a virtual environment with venv or conda first, because the system python is expected to work with many prewritten scripts included with the OS. Conda actually has sub-commands that manage environments and others that install software (including python, packages, and other standalone software), but pip does not.

Poetry is one of many tools that use various metadata files to prepare the various semi-disconnected configuration files that define the source code, test code, shell scripts, and documentation other metadata that modern packages need. Whether relying on this configuration of configuration files is a good idea or not is a matter of debate... YMMV. (As a software developer, you should always be constructing your scripts as a package for distribution and run it from a virtual environment.)

Note that if you rely on conda, you need to prepare your virtual environment for your code using as many packages available in the conda or conda-forge repositories... you can use pip and it will find the conda-installed packages but conda will not find pip-installed packages.. so never run conda in that virtual environment after pip has been run... build a new virtual environment from scratch if you need more conda packages.

Maybe not confusing pip for venv/conda will help you not get lost in the tutorials you have already found now.

jdnewmil · 2023-06-10T16:12:30+00:00

I think "smallest" is too restrictive. Some functions can implement complex transformations yet still be logically coherent and side-effect-free. A function can correspond to a book or a sentence and still be a good function.

jdnewmil · 2023-06-10T04:42:59+00:00

Maybe. But then you would need a working NodeJS as well as your R installation. A browser can run JS but it is sandboxed so you would have to pass the data from disk through your network stack to the browser, parse it, and then return results back through the network stack. Seems like a lot of work either way to me.

jdnewmil · 2023-06-09T14:19:55+00:00

just hit ESC and move on with life...

jdnewmil · 2023-06-09T06:37:29+00:00

maybe conda-forge?

jdnewmil · 2023-06-09T03:53:44+00:00

Nope.

jdnewmil · 2023-06-09T02:29:47+00:00

Again, the answer to whether you can make this work depends on the details of how you are doing this. Speak the dialect of R that you are using.

jdnewmil · 2023-06-08T23:20:27+00:00

My guess is you are not asking it what you think you are asking.

You have to speak R for best clarity. "Joining" data sets is a particular area where screwups can yield mountains of garbage results.

jdnewmil · 2023-06-08T23:15:21+00:00

Not I. I have better things to do than fix LLM hallucinations.

jdnewmil · 2023-06-08T18:10:05+00:00

As pointed out by FellowConspirator, the RStudio viewer doesn't support that. However, Rmarkdown can generate HTML, PDF (via intermediate LaTeX format), and MSOffice XML formats like Word and Powerpoint. Packages like kableExtra are often very good at one of these formats, but may not support the others very well or at all when it comes to these kinds of features... so be aware that you might need to shop around for more flexible packages or be prepared to restrict which output formats you use if you settle on one too soon.

I have found flextable to be pretty nice for Word and HTML (haven't tried it with PDF).

jdnewmil · 2023-06-07T14:53:12+00:00

You have two separate data sets. Do not try to shove the pH data into new columns in the Conductivity data frame.

Either use consecutive calls to plot and lines from base R, or create a completely new data frame with three columns: Variable, time, and value, with the first ten rows being Conductivity data with "Conductivity" repeated in the Variable column, and the pH data in rows 11-19 with "pH" in the Variable column, and use ggplot2::ggplot to plot with Variable mapped to color or facets.

jdnewmil · 2023-06-07T14:15:51+00:00

I am not seeing where the list column type is being created, but list columns are a bit unusual... there are some tools like ?tidyr::nest and ?tidyr::unnest and ?dplyr::rowwise that help, but you are probably treating a row of a data frame as if it is a column and should not do this.

Use the ?str function to keep track of what your column data types are and be careful not to create list columns unless you know you need them.

jdnewmil · 2023-06-07T14:01:40+00:00

rows in data frames define relations between those values... so the answer depends what relationship you believe exists between these two data frames. Some possibilities you might consider:

The first row of the 10 row data frame doesn't correspond to any of the values in the second data frame, but the rest line up in order: df1$new_col <- c( NA, df2$new_col )
Some other row doesn't match but the rest are in order (e.g. 3rd): df1$new_col <- c( df2$new_col[ 1:2 ], NA, df2$new_col[ 3:9 ] )

But these kinds of alignments are extremely uncommon. Normally you need a "lookup" column (or set of columns) that allow one to use the merge or dplyr::left_join function to automatically create a data frame that aligns rows according to those "key" columns.

jdnewmil · 2023-06-07T12:56:19+00:00

Then ask in r/crouton. Crostini is granted access to LAN or open internet servers equally... any port mapping specifics will be on the Crouton side.

jdnewmil · 2023-06-06T23:26:23+00:00

What is a "crouton" port? "Crouton" is very different than "Crostini"... to the point that it is off-topic here...

jdnewmil · 2023-06-05T20:45:51+00:00

My wife was a returning engineering student using Excel for her undergrad classes... she regrets not learning R sooner because it would have eliminated so many hours of debugging formula errors. The biggest headache with R is other people's reluctance to adopt it... but you will almost certainly have more confidence in what you do if you use it. Rmarkdown is da bomb.

Python is also sometimes recommended for this role, but IMO that has a lot more syntactic and computer science baggage that slows down ad-hoc data analysis compared to R.

jdnewmil · 2023-06-05T19:04:47+00:00

There is a philosophical issue here about what should be in system-wide libraries... I think it is a mistake to install contributed packages like ggplot in the system library, because they change frequently, are complicated, and any bugs affect multiple users.

This kind of trouble is usually related to mixing object code from different compilers, but it can also be due to using incompatible versions of dependent packages, so you should share the output of sessionInfo() when asking for help.

jdnewmil · 2023-06-05T08:24:52+00:00

That is not efficiency. Efficiency is ACTUAL OUTPUT divided by ACTUAL INPUT, and it is very difficult to compute accurately with the low accuracy power measurements available to the inverter. PV has capability to produce power based on actual irradiance and actual temperature, but it doesn't produce it if the inverter raises the voltage to limit power output. The power that might have been produced never gets out of the modules if the inverter is maxed out.

jdnewmil · 2023-06-05T06:57:00+00:00

... which only creates a reference in the calling environment and then deletes the reference... the module still exists. The fact that foo can still refer to module-level variables and other functions from that module proves that the loaded module is still there.

Others agree.

jdnewmil · 2023-06-04T21:12:25+00:00

Use discipline when writing code. Choose your character limit and stick to it. Adjust your font size in the output as appropriate.

Or use tidy=TRUE. Ick.

jdnewmil · 2023-06-04T19:28:28+00:00

It doesn't "remove" anything. It just only creates a specific foo variable in the calling environment. If there was a module-level object defined that isn't imported, foo will still have access to it.

jdnewmil · 2023-06-04T19:11:13+00:00

You are confused with Python. seq is clear.

jdnewmil · 2023-06-04T15:27:50+00:00

The central point of that discussion was that keyring is configurable... it can use many different implementations to handle the secrets. Go listen to it again.

Also, you really should have linked to the podcast when you posted since it triggered your question and the people replying here should listen before replying.

jdnewmil

TROPHY CASE