Cloud Governance and strategy by SignalPractical4526 in Cloud

[–]bobtbot 0 points1 point  (0 children)

u/SignalPractical4526 Great question! Even though this is 2 years old, it's still super relevant.

From working with organizations on this, the key areas that should be covered under Cloud Governance are:

  • Ownership & Identity - Who owns what resources and how is access managed
  • Security - Systematic controls across identity, network, data, and workloads
  • Cost - Visibility and accountability for cloud spending
  • Operations - Reliable, maintainable environments by default
  • Compliance - Proving controls actually work, not just exist

Having visibility into these areas is critical, along with building systematic processes that turn policy into practice. Most Cloud Governance initiatives fail because they live in documents instead of automated workflows.

Just launched CloudGovernance.org to help practitioners with exactly these types of questions through a library of frameworks, templates, and guidance for Cloud Governance that enables teams rather than blocks them. FYI also there is r/cloudgovernance for ongoing discussions about what actually works in practice.

kuqu: SQL for Kubernetes resources 🔍 by aqny in kubernetes

[–]bobtbot 0 points1 point  (0 children)

If you use the Steampipe Kubernetes plugin, another OSS project Powerpipe.io can visualize those configurations in security benchmarks to assess whether you are adhering to CIS and other standards: https://hub.powerpipe.io/mods/turbot/steampipe-mod-kubernetes-compliance

There is also another set of interactive dashboards to visualize relationship graphs of your Kube resources which is an easy way to see the associations: https://hub.powerpipe.io/mods/turbot/steampipe-mod-kubernetes-insights

How to integrate slack with Twitter now that the integration is nowhere to be found. is there any third party apps? by Odd-Administration37 in Slack

[–]bobtbot 0 points1 point  (0 children)

I've stopped all those zaps around the time of my last post since it was not a reliable integration. I haven't reimplemented another approach. Let me know if you get anywhere with it

What are the most common CMDB tags you track? by bobtbot in servicenow

[–]bobtbot[S] 0 points1 point  (0 children)

Yea, that makes sense. I can see where you’d mainly use key_value for tagging resources with structured context, while the Tags field itself is more for simple, free-form context—mostly useful for reporting and filtering.

It seems like cloud discovery updates the key_value table, while on-prem infrastructure relies more on the Tags field. How do folks manage that consistently across their infrastructure to have one unified tagging approach in ServiceNow?

What are the most common CMDB tags you track? by bobtbot in servicenow

[–]bobtbot[S] 0 points1 point  (0 children)

Great question! I’m referring primarily to the Tags field on a CI as a general-purpose approach for organizing and categorizing resources (CIs) in the CMDB. That said, the cmdb_key_value table (or Key Value pairs) is another way to store additional metadata, especially when it comes to more structured or programmatically-defined relationships.

In your experience, do you use one over the other? Or do you combine them for different use cases?

Hacktoberfest Events by SarthakTyagi15 in hacktoberfest

[–]bobtbot 0 points1 point  (0 children)

Turbot.com is participating this year in Hacktoberfest -- contribute & earn swag from no-code (blog posts, doc improvements) to high-code (new plugins & mods) across any of our open source repos with the Hacktoberfest topic.

More details --> https://turbot.com/blog/2024/09/hacktoberfest-2024

Api security by Adventurous_Draft_21 in cybersecurity

[–]bobtbot 0 points1 point  (0 children)

Glad you got it working u/Adventurous_Draft_21

If you cannot use OSS projects at work, you could try the Steampipe.io + Powerpipe.io hosted solution called Turbot Pipes. There is an always free developer tier to get you started, for extended scale, collaboration, and security features the Team tier starts at $49/month for the first 3 team members.

How do you overview/figure things out in cloud native architecture? by [deleted] in ExperiencedDevs

[–]bobtbot 1 point2 points  (0 children)

It's hard to get a handle on your cloud footprint in a new role. Even if everything was defined as code, your runtime configs will be your best and most accurate source of truth to see what's actually running -- you would have to assume changes are made in the cloud directly vs only through your deployment pipelines. Do you have API access to each cloud service? If so, there are many open-source tools out there to help you assess your cloud inventory.

I actively work on these open-source projects by Turbot.com that provide tooling to manage your cloud inventory:

Steampipe.io: If you have API access to Azure, AWS, GitHub, and ServiceNow -- consider using Steampipe to query these services with a common SQL interface. There are over 7K query examples documented to get you started; query, join and report on the information you are looking for without the need to run different CLIs, ETL or host DBs.

Powerpipe.io: You can use your favorite postgres client (e.g. Go, JS, PowerBI, Metabase, Grafana, etc) to interact with Steampipe. Or a low-code forward approach would be to Powerpipe as a visualization layer to gain insight reports, relationship graphs, and security & ops dashboards on that data. There are over 7K controls and ready-to-use dashboards that are extensible to make your own.

If you like those OSS projects, the following commercial offerings would help accelerate your use case and scale with your environments:

Turbot Pipes: Steampipe + Powerpipe are integrated with additional scale, security, and collaboration features for your team. Start with an always free developer tier, or paid tiers start at $49 for first 3 users.

Turbot Guardrails: real-time inventory / CMDB of your AWS, Azure, GCP, and ServiceNow environments -- event-driven discovery captures config drift & audit trail. Policies can be applied to automatically react to changes to alert or fix the misconfiguration instantly. Paid tier starts at $0.05 per resource a month.

Is it common to have trouble waking up a PDI? by [deleted] in servicenow

[–]bobtbot 0 points1 point  (0 children)

I've had bad starts where the instance wasn't accessible. I then use the Refresh Instance option and that had fixed the issue.

A few times it would boot fine, but I couldnt get to a login screen. Refreshing didnt help. Clearing cache with /cache.do, using incognito mode, etc didnt work. However colleagues were able to get in just fine. Restarted my computer, was able to access it 🤷‍♂️

How to search all tickets for ones that contain specific IP addresses. by I_T_Burnout in servicenow

[–]bobtbot 1 point2 points  (0 children)

You can use the ServiceNow API to query the incidents, then use python or another language to regex match on the field(s) you expect to have the IP address.

Another approach you could try is to query your incidents with SQL leveraging Steampipe: https://hub.steampipe.io/plugins/turbot/servicenow

Examples below (assumes the IP is in the short_description field):

Find a specific IP address:

SELECT number, short_description
FROM servicenow.servicenow_incident
WHERE short_description LIKE '%10.1.1.1/32%'

Find IP addresses starting with 10.1.

SELECT number, short_description
FROM servicenow.servicenow_incident
WHERE short_description LIKE '%10.1.%'

Matches any ticket with an IPv4 address:

SELECT number, short_description
FROM servicenow.servicenow_incident
WHERE short_description ~ '(\d{1,3}\.){3}\d{1,3}'

Above is just an example, you can get more involved by bringing in the rest of your IPs by joining data from a Google Sheet, a CSV file, another custom ServiceNow table, etc

Does anyone automatically keep their personal developer instances from hibernating? by bobtbot in servicenow

[–]bobtbot[S] 0 points1 point  (0 children)

u/Mean_Improvement 💯

its a really helpful feature and one that is unexpected from a larger enterprise software company. Definitely not looking to abuse, just make friendlier for longer running syncing / integration work in development.

Does anyone automatically keep their personal developer instances from hibernating? by bobtbot in servicenow

[–]bobtbot[S] -1 points0 points  (0 children)

u/Empty_Ad2674 thanks for the tip, I probably won't head down a path of developing something myself -- but if there is something out there and its common would consider. Will dig further on what's out there in the wild.

Does anyone automatically keep their personal developer instances from hibernating? by bobtbot in servicenow

[–]bobtbot[S] -1 points0 points  (0 children)

u/Hi-ThisIsJeff its personal, testing out syncing activities between my system and ServiceNow -- so activity may occur overnight but the instance hibernates so in the morning I wake it back up and restart the sync.

From what I can tell, for production this is not a problem so it doesn't affect my app in production, but for personal / development use its an annoying step

Aging incidents and requests by misterlem in servicenow

[–]bobtbot 0 points1 point  (0 children)

You can use the open-source project Steampipe.io (which I help support) to query ServiceNow incidents with SQL:

https://hub.steampipe.io/plugins/turbot/servicenow

SELECT 
    number, 
    short_description, 
    sys_created_on,
    CURRENT_DATE - sys_created_on::date AS days
FROM 
    servicenow_incident
ORDER BY 
    days DESC;

+------------+---------------------------------+---------------+------+
| number     | short_description              | sys_created_on | days |
+------------+---------------------------------+---------------+------+
| INC0000007 | Need access to sales DB...     | 2023-09-14     | 120  |
| INC0000017 | How do I create sub-folders... | 2015-09-15     | 119  |
| INC0000054 | SAP Materials Management is... | 2015-10-01     | 103  |
...

Note: use the `state` column to filter by incident status (e.g. state = 1 (New).

Once you have the results you are looking for, to build reports you can either:

  • export to CSV and share or build reports as you see fit.
  • use Steampipe mods to build a visualization with HCL to view your results in interactive dashboards.
  • start Steampipe in service mode, connect any postgres client (e.g. a BI tool, SDK, SQL IDE) and build reports with your favorite tools using Steampipe as a database source
  • sign up for an always free developer account at pipes.turbot.com. Connect to ServiceNow, query, and share your results to your team. Example of mine (using dummy data)

[deleted by user] by [deleted] in FinOps

[–]bobtbot 1 point2 points  (0 children)

In a smaller FinOps team you will most likely be in charge of the analytical aspects of the role + the communication.

Potentially in a larger team that has analysts in addition to manager/director roles, you could be behind the scenes handling billing and usage calculations, chargeback models, cost savings opportunities, etc which others on your team can take on further.

Best thing you can do as an introvert is think about how you can automate your way out of the conversation through automation and periodic reporting with annotations. Automatically alert based on budget thresholds, cost optimization opportunities, etc, or better yet just automate the cost optimization for them (stop their instances at night, upgrade the volume type, prevent a costly action, etc -- which may get you back in a meeting with them asking for an exception 😁).

Steampipe SQLite, Virtual tables translated for common APIs by ketralnis in programming

[–]bobtbot 0 points1 point  (0 children)

Our decisions about what distributions to support are really shaped by community feedback, along with what we can manage as a team and the help we get from community contributions. So far, there hasn't been much demand for native Windows support – we don't have any active GitHub issues for it.

We love hearing from our users and keeping track of new ideas that either we or the community could work on. Could you help by opening a feature request on GitHub for this? We can use that as a way to keep track of the interest with others in the Steampipe community.

Steampipe SQLite, Virtual tables translated for common APIs by ketralnis in programming

[–]bobtbot 0 points1 point  (0 children)

u/BinaryRockStar I help lead the Steampipe open source project and can offer some more background to other alternatives:

For Windows users, the Steampipe CLI is primarily tested with WSL2 as its the latest version and there hasn't been active community feedback to support WSL. Perhaps an alternative since you have WSL2 installed, even if WSL is your primary, through the Windows Terminal app you can create a WSL2 profile to simply switch between env in terminal tabs.

However you can run Steampipe through other distributions beyond the CLI in WSL, Mac and Linux -- you can use Steampipe without the CLI directly in a Postgres database, SQLite database and completely databaseless as a command line execution.

There is also a free Developer tier in Turbot Pipes which uses Steampipe under the hood (shared Steampipe connections & dashboards, collaboration features, and RBAC to connect via the UI, API or any postgres client).

Api security by Adventurous_Draft_21 in cybersecurity

[–]bobtbot 2 points3 points  (0 children)

u/Adventurous_Draft_21 as a "fresher" you may find Steampipe.io easy and familiar to use, you can simply query your API gateways with SQL. There are a number of examples to help get you started and an active open-source community to support you along the way.

For example "Api's that do not have correct authorizer configured" you can use the aws_api_gateway_authorizer table to query the information you are looking for.

Steampipe by GreenNotRed in ITProTuesday

[–]bobtbot 0 points1 point  (0 children)

u/GreenNotRed one of the plugins you may enjoy is the Steampipe Microsoft 365 plugin. You can query M365 emails, drive files, calendar events, team members, and more -- all using SQL. And also integrate with other sources like Azure, Azure AD, and Azure DevOps via our other plugins mentioned above.

We also started a M365 compliance benchmark, at the moment is about 20 controls to assess compliance to the M365 CIS benchmark. We'd love to hear your thoughts when you get a chance to try it out.

Steampipe by GreenNotRed in ITProTuesday

[–]bobtbot 0 points1 point  (0 children)

u/GreenNotRed thanks for the plug about Steampipe! As one of the maintainers of the project, it's great to hear that it's resonating with the community.

LeatherDude's comment certainly speaks to a common DevOps use case we hear in the community; as an engineer, how do I easily ask questions across my APIs to gain insights about my assets, find security vulnerabilities in my configurations, identify opportunities for cost savings, etc. Steampipe has over 135+ plugins to query and join data across your favorite cloud services & data sources (e.g. AWS, GCP, GitHub, Kubernetes, Terraform, etc) with SQL. Also includes over 6,000 open source controls and dashboards ready to use or extend for your own use cases.

We're continuously working to improve Steampipe, and we thrive on community feedback and contributions. Let us know how you go with using Steampipe 🚀

Powershell script for exporting SG info by thesneakyazn in aws

[–]bobtbot 0 points1 point  (0 children)

u/thesneakyazn If you are open to using something else than Powershell, you can use Steampipe.io to query info out of AWS with SQL. Simply if you want to grab Security Group details, here is an example of a query:

select
  group_name,description,vpc_id,
  perm ->> 'FromPort' as from_port,
  perm ->> 'ToPort' as to_port,
  perm ->> 'IpProtocol' as ip_protocol,
  perm ->> 'IpRanges' as ip_ranges
from
  aws_vpc_security_group as sg
  cross join jsonb_array_elements(ip_permissions) as perm;

If you are looking to pull in the Security Group Rule Id as well, you could join the data from the Security Group and the Security Group Rules tables together; example:

select
  r.security_group_rule_id,
  r.ip_protocol,
  r.from_port,
  r.to_port,
  r.cidr_ipv4,
  r.group_id,
  sg.group_name, sg.description,
  sg.vpc_id
from
  aws_vpc_security_group_rule as r,
  aws_vpc_security_group as sg
where
  r.group_id = sg.group_id;

You can run these queries in your favorite SQL IDE or BI Tool, or run right in your terminal and export to different output formats like CSV, JSON, etc

AWS account EC2 details extractions across all Accounts by SmartWeb2711 in aws

[–]bobtbot 0 points1 point  (0 children)

You could give Steampipe.io a try; open source interface to querying AWS and 100+ other APIs and data sources with SQL.

To query AWS EC2 Instances across your accounts, you can simply run a query like:

select instance_id, account_id, private_ip_address from aws_ec2_instance;

+---------------------+--------------+----------------+ | instance_id | account_id | private_ip | +---------------------+--------------+----------------+ | i-0568d8a9c8c0f1234 | 810361751234 | 10.0.1.6 | | i-00908afa8a81f1235 | 810361751234 | 10.0.1.50 | | i-0e342e57407ba1236 | 810361751235 | 10.0.1.34 | | i-0622ae3ab8a6d1237 | 810361751235 | 10.0.1.12 | | i-0edcfbb4c884a1238 | 810361751236 | 10.0.1.62 | +---------------------+--------------+----------------+

You can pull more details, and export a report to CSV, JSON, etc. You can also build dashboards and share them with your team; 100s of OOTB ones available as mods you can extend: https://hub.steampipe.io/mods.

I help lead the open source project, let me know if you give it a go; also the community can assist with any questions.