SaaSHub helps you find the best software and product alternatives Learn more →
Top 23 Python AWS Projects
-
devops-exercises
Linux, Jenkins, AWS, SRE, Prometheus, Docker, Python, Ansible, Git, Kubernetes, Terraform, OpenStack, SQL, NoSQL, Azure, GCP, DNS, Elastic, Network, Virtualization. DevOps Interview Questions
-
LocalStack
💻 A fully functional local AWS cloud stack. Develop and test your cloud & Serverless apps offline
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
data-science-ipython-notebooks
Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.
-
awesome-aws
A curated list of awesome Amazon Web Services (AWS) libraries, open source repos, guides, blogs, and other resources. Featuring the Fiery Meter of AWSome.
-
prowler
Prowler is an Open Source Security tool for AWS, Azure, GCP and Kubernetes to do security assessments, audits, incident response, compliance, continuous monitoring, hardening and forensics readiness. Includes CIS, NIST 800, NIST CSF, CISA, FedRAMP, PCI-DSS, GDPR, HIPAA, FFIEC, SOC2, GXP, Well-Architected Security, ENS and more
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
serverless-application-model
The AWS Serverless Application Model (AWS SAM) transform is a AWS CloudFormation macro that transforms SAM templates into CloudFormation templates.
-
checkov
Prevent cloud misconfigurations and find vulnerabilities during build-time in infrastructure as code, container images and open source packages with Checkov by Bridgecrew.
-
dev-setup
macOS development environment setup: Easy-to-understand instructions with automated setup scripts for developer tools like Vim, Sublime Text, Bash, iTerm, Python data analysis, Spark, Hadoop MapReduce, AWS, Heroku, JavaScript web development, Android development, common data stores, and dev-based OS X defaults.
-
cloud-custodian
Rules engine for cloud security, cost optimization, and governance, DSL in yaml for policies to query, filter, and take actions on resources
-
image-super-resolution
🔎 Super-scale your images and run experiments with Residual Dense and Adversarial Networks.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
Project mention: LocalStack – a functional local AWS cloud stack | news.ycombinator.com | 2024-04-05
The AWS CLI is a must-have tool if your team relies on Amazon Web Services. It lets you effortlessly interact with AWS services, orchestrate resource management, and automate tasks from the comfort of your terminal. Once you get used to the tool, you'll notice how convenient and quick it is to fit into your processes – especially compared to going through AWS's web-based user interface.
Project mention: Superpower REST API DX with Serverless ⚡ and DevOps Best Practices on AWS (🐍 Python Version) | dev.to | 2024-04-30If you want to write serverless apps with Python without using Serverless Framework, you can ship them with Chalice.
1. Prowler: https://github.com/prowler-cloud/prowler Prowler provides security best practices assessments, audits, incident response readiness, and continuous monitoring for AWS environments.
The complete solution with SAM is available here.
Former AWS here.
My literal job for the last part of my time at AWS was "help triage bugs in the AWS SDK." This is by far the best repro I've ever seen for such an in-depth event.
Most of the tickets you get in open ticket trackers are incomplete [ https://github.com/boto/boto3/issues/4011 ] nonsensical [ https://github.com/boto/boto3/issues/4018 ] or weird [ https://github.com/boto/boto3/issues/358 ].
> OpenMoto
I dunno if you're trying to play on "hashimoto" but https://github.com/getmoto/moto#readme would be a prime name collision for any such "OpenMoto" name
But yes, please, to adopting Vault. I don't have a horse in the race about Consul but my suspicion is such an effort would only be worthwhile if trying to adopt Nomad, too, which I gravely doubt
While at it - I heartily recommend you to install aws-shell which boosts your aws cli productivity by providing graphical autocompletion, hints and shortcuts as shown in the image below. I only discovered it recently myself and it's definitely a game changer!
1. Checkov: https://github.com/bridgecrewio/checkov Checkov is a static code analysis tool that helps developers prevent cloud misconfigurations during the development phase by scanning Terraform, CloudFormation, Kubernetes, and more.
Prowler and ScoutSuite are a good start for cloud stuff.
Project mention: Cutting down AWS cost by $150k per year simply by shutting things off | news.ycombinator.com | 2024-01-22> The best optimization is simply shutting things off
This is the way.
A similar idea has been bouncing around in my mind for a while now. An ideal, turnkey system would do the following:
- Execute via Lambda (serverless).
- Support automated startup and shutdown of various AWS resources on a schedule influenced by specially formatted tags.
- Enable resources to be brought back up out of schedule when demand dictates.
- Operate as a TCP/HTTP proxy that can delay clients so that a given service can be started when it is dormant or, even better, the service isn't serverless but you want it to be. This can't work for everything, but perhaps enough things such that the need to run always on services is reduced.
Cloud Custodian [1] can purportedly do some of this, but I've been reluctant to learn yet another YAML-based DSL to use it.
So this is my "make things designed to be always-on serverless instead" project and the work AWS has done to make Java apps function on Lambda keeps me thinking about the potential to take things that 1) have a relatively long startup time and 2) are designed to be long running service loops, and find a way to force them into the serverless execution model.
[1] https://cloudcustodian.io/
Project mention: Show HN: Use function calling to build AI Assistants | news.ycombinator.com | 2024-02-27
Project mention: Show HN: Auto Wiki v2 – Turn your codebase into a Wiki now with diagrams | news.ycombinator.com | 2024-04-23https://github.com/awslabs/gluonts is a great candidate for a sample wiki. It is an OSS lib, not great documentation, very hard to RTFM (unlike, say, sklearn which already has a great wiki), doubtful that awslabs would pay to produce.
Python AWS related posts
-
OPA, Cedar, OpenFGA: Why are Policy Languages Trending Right Now?
-
Pyinfra: Automate Infrastructure Using Python
-
Superpower REST API DX with Serverless ⚡ and DevOps Best Practices on AWS (🐍 Python Version)
-
AWS Serverless Diversity: Multi-Language Strategies for Optimal Solutions
-
Turbocharge your Lambda Functions with AWS Lambda Powertools for Python
-
Runhouse
-
Adding Cognito Authentication to our Serverless Dash App
-
A note from our sponsor - SaaSHub
www.saashub.com | 4 May 2024
Index
What are some of the best open-source AWS projects in Python? This list will help you:
Project | Stars | |
---|---|---|
1 | devops-exercises | 63,556 |
2 | LocalStack | 52,204 |
3 | data-science-ipython-notebooks | 26,490 |
4 | aws-cli | 14,897 |
5 | awesome-aws | 12,165 |
6 | chalice | 10,312 |
7 | prowler | 9,571 |
8 | serverless-application-model | 9,237 |
9 | boto3 | 8,703 |
10 | docker-android | 8,181 |
11 | ansible-for-devops | 8,032 |
12 | metaflow | 7,607 |
13 | Moto | 7,394 |
14 | aws-shell | 7,122 |
15 | checkov | 6,540 |
16 | aws-sam-cli | 6,445 |
17 | ScoutSuite | 6,176 |
18 | dev-setup | 6,032 |
19 | cloud-custodian | 5,219 |
20 | SAWS | 5,189 |
21 | phidata | 4,654 |
22 | image-super-resolution | 4,499 |
23 | gluonts | 4,297 |
Sponsored