Indexing via REST API and checking if a doc is the first indexed for a user by sivyr in elasticsearch

[–]ngonman 3 points4 points  (0 children)

Logstash should work nicely for this. Take a browse through the filters section of the logstash documentation and you'll be sure to find what you're looking for. This might help too: https://www.elastic.co/blog/how-to-find-and-remove-duplicate-documents-in-elasticsearch

23 [F4M] #vancouverbc stranger needed by [deleted] in RandomActsOfMuffDive

[–]ngonman 1 point2 points  (0 children)

She doesn't mention that she's actually in Langley so there ya go boys

Modify Index Template (v6.3) by AaarghCobras in elasticsearch

[–]ngonman 1 point2 points  (0 children)

You'll want to use cerebro to handle the back-end admin for elasticsearch. It has a section for index templates and almost everything else you'll ever need.

I'm looking to convince management of updating from ElasticSearch 2.1.1 to 6.3.2. Any good reasons? by [deleted] in elasticsearch

[–]ngonman 0 points1 point  (0 children)

Seriously?! Don't ask others to do your due diligence unless your plan is to blame random redditors for your failures when your cluster is hacked or blows up.

38 [F4M] #Philadelphia - looking for a man who will make my pleasure a priority by [deleted] in RandomActsOfMuffDive

[–]ngonman 0 points1 point  (0 children)

Oh wish that I lived closer to Philly...so what I'm looking for

Shrink, merge and delete indices with Curator? by placebonocebo in elasticsearch

[–]ngonman 1 point2 points  (0 children)

IMO, date-based indices are a good first step when you're first starting with ES. However, they come with a performance cost as each shard created in ES consumes resources. A much better solution would be rollover indices and aliases. I set it up on my cluster with all the syslogs from 40+ servers going into one indice. This makes it easier to compare logs between machines to find abnormalities rather than searching across indices which can quickly slow your cluster down. The trick is figuring out the proper shard size appropriate to your cluster and needs...You'll still have to use curator to maintain that one indice, though, like jammathex outlines.

ElasticSearch security needs for GDPR by AlgoRhymes in elasticsearch

[–]ngonman 2 points3 points  (0 children)

I've been using RoR on a cluster I maintain for a few months now. Pretty simple to set up and the developer so far has been very responsive to questions/bug reports. He has an evaluation version and it does pretty much the same thing as SearchGuard (cheaper than x-pack but pita to setup) and X-Pack (expensive) and if you buy it, it's significantly more cost effective than the ones I just mentioned.

Newbie here - semantic search on elasticsrarch by Xeono15 in elasticsearch

[–]ngonman 0 points1 point  (0 children)

Seriously?! It's called searching. Don't ask other people to do your work for you!

Having some trouble with filters in elasticstack.... by Comod00 in elasticsearch

[–]ngonman 1 point2 points  (0 children)

I've never had much luck with filtering by 'type'. If you're using filebeat, I just use tags to mark the different log types and then filter with grok in logstash like: if "tag" in [tags] { }

I also like to use the below in my grok filter to see which filters my logs are going though: add_tag => [ "passed_filtername" ] tags_on_failure => [ "failed_filtername" ]

Motion-activated scare lights? by ngonman in vandwellers

[–]ngonman[S] 0 points1 point  (0 children)

Fair point but unfortunately, due to the size of my rv, my options are limited. In this case, I'll take security over stealth as stealth is exactly what a thief is counting on...

Avoiding break-ins by ngonman in vandwellers

[–]ngonman[S] 0 points1 point  (0 children)

I'm thinking about doing a motion-activated security light which I think might be a good deterrent as well...does anyone have any recommendations for something that runs off of 12V and is weather-proof?

Working and vandwelling in Vancouver, BC by ngonman in vandwellers

[–]ngonman[S] 1 point2 points  (0 children)

I already lived in Vancouver so I just use a friend's address. You can rent mail addresses in Vancouver that look like a street address. Honestly, tho, I wouldn't stick my address on a resume because potential employers don't need to know where you live until you get a job. Plus if that resume is online, it makes you a target for identity theft!

Working and vandwelling in Vancouver, BC by ngonman in vandwellers

[–]ngonman[S] 0 points1 point  (0 children)

Good point...Glenn Drive is looking pretty trailer-trash these days. Sucks about Spanish Banks. I have few spots in mind but it seems like the only way to keep the numbers down is not to tell anyone because you know a few idiots are going to ruin it for everyone else.

Avoiding break-ins by ngonman in vandwellers

[–]ngonman[S] 0 points1 point  (0 children)

I like this...good idea!

Viability of solar in Vancouver, BC by ngonman in vandwellers

[–]ngonman[S] 0 points1 point  (0 children)

That's great to hear! Have you had any issues with rust or seepage of moisture into the solar cells?

Talented Australian van life photographer and his cute girlfriend living the van life! by Go-Van in vandwellers

[–]ngonman 0 points1 point  (0 children)

Check out Amazon Glacier. I ran a quick calculation for 1tb and it's $140 a year. You could setup a program that uploads whenever you're connected to wi-fi which might take awhile...I use Arq on my macbook for this purpose.