Metricfire logo
locale
+1 (855) 206-7352 Get Started
Metricfire logo
+

Monitoring GitHub with AWS Kinesis Streams

Integrating GitHub and AWS Kinesis Streams with your monitoring system

To integrate GitHub and AWS Kinesis Streams with your monitoring system, please reach out to MetricFire. Book a demo with the MetricFire team to discuss integrating GitHub and AWS Kinesis Streams and how that can support your monitoring system.

What is GitHub?

Visualize GitHub Events with Webhooks

MetricFire makes it easy to collect data from your repositories, and visualize GitHub events in the form of dashboard annotations. To enable our webhook integration, copy the webhook from Add-Ons => GitHub in your Hosted Graphite account:

 



github-webhook

 

Then add the webhook to your GitHub repo, in the ‘settings’ section => ‘webhooks’

 

github-webhook-config 



Now you can save, and your GitHub events will now be sent to the webhook URL and saved on your account as Annotations. Use the following tags to query the annotations you want to display:


  1. Push Event Tags – ‘github’, ‘push’, <repo>, <branch>, <user>
  2. PR Event Tags – ‘github’, ‘pull-request’, <action>, <repo>, <user>
  3. Deploy Event Tags – ‘github’, ‘deployment’, <status>, <repo>, <user>, <environment>



 github-annotation-config



Visualize GitHub Metrics using the Telegraf Agent

Additionally, there is also a Telegraf Input plugin for GitHub. This plugin will send a variety of metrics to your Hosted Graphite account for increased visibility into your repositories. See our handy blog article with detailed configuration instructions HERE, and the official GH repository HERE.



github-example-dash

What is AWS Kinesis Streams?

Collect and Forward Kinesis Streams Metrics from AWS Cloudwatch

MetricFire has an easy to use integration that pulls metrics from the Cloudwatch API, and forwards them to a Hosted Graphite account. You can configure this integration in a few simple steps:



  1. In your Hosted Graphite account, navigate to Add-Ons => AWS and +Add an AWS account by entering your Access key and Secret key.
  2. Now you can select which AWS services to pull metrics from, and even enable metric tagging (optional). Learn more about our AWS integration in the Hosted Graphite Cloudwatch docs.
  3. You can also name the account you've configured. This is recommended, especially if you are configuring multiple AWS accounts like dev, stage, and prod.
  4. Depending on your enabled AWS services and internal permissions settings, you might need to add our default AWS Policy to your IAM user to allow us to pull metrics from your AWS account.
  5. Metrics should be hitting your Hosted Graphite account within about 10 minutes. You can use these metrics to create custom Dashboards and Alerts, and you'll notice that some new dashboards have been automatically created in your HG account. We also have a handy AWS Overview dashboard that can be found in our Dashboard Library, which offers a great starting point.



aws-config



aws-dash



If you have any issues with configuring this integration, or need to integrate with a service that is not currently listed, please contact our team. We will be happy to help you out, and develop new AWS integrations for you!

What is MetricFire?

MetricFire is a full-scale platform that provides infrastructure, system, and application monitoring using a suite of open-source tools. We will aggregate and store your data as time series metrics, which can be used to build custom dashboards and alerts. MetricFire takes away the burden of self-hosting your own monitoring solution, allowing you more time and freedom to work on your most important tasks.

 

     hg-main-page

         

 

MetricFire offers a complete ecosystem of end-to-end infrastructure monitoring, comprised of open-source Graphite and Grafana. MetricFire handles the aggregation, storage, and backups of your data, and offers alerting, team features, and API's for easy management of your monitoring environment. You can send server metrics using one of our agents, custom metrics from within your application code, and integration metrics from a variety of popular 3rd party services that we integrate with like Heroku, AWS, Azure, GCP, and many more!

         

Our Hosted Graphite product has improved upon standard Graphite to add data dimensionality, optimized storage, and offers additional tools and features that provide customers with a robust and well-rounded monitoring solution.

       

Benefits of Using MetricFire:

  • Simple, low-cost pricing
    A structured pricing model based on total unique time series metrics allows you to work within your budget. The predictability and transparent pricing allows you to keep your costs in check and plan for the future. 1 metric is 1 metric regardless of the source, or requests sent to and from the metric namespace.
  • Easy-to-use dashboards
    Our Hosted Dashboards provide endless options for customizing your visualizations, and allow you to share dashboards with clients.
  • Responsive alerting
    Receive alert notifications quickly through Email, PagerDuty, Slack, Microsoft Teams, OpsGenie, and custom webhooks.
  • Freedom of customization
    Send custom application metrics through your code. Our Language Guide can help you update your codebase to send event metrics via socket connections.
  • Fantastic customer support
    Fast and friendly support is provided by engineers, for engineers, to get you set up quickly. Start a conversation with us through the chat bubble below!
  • Enterprise-ready
    Dedicated clusters for users that need their own environment with custom parameters. Please reach out to us for more information.
      
The author for this testimonial, Jim Davies, Head of DevOps, MoneySuperMarket.com.
“As MetricFire scales effortlessly, we can push and store more metrics than we really need today but might need tomorrow. This increases our depth of understanding of the systems that we run and heads off any future problems.”
Jim Davies, Head of DevOps, MoneySuperMarket.com.

Don't just take our word for it

Why thousands of engineers choose us:

fingerprint icon Own your data
dollar icon Major savings
eye icon Nothing hidden
face icon Engineering support

Vendor lock-in's not our thing. We’re believers in you still owning your data, so you can request a full export at any time. That means you get all the benefits of an open-source tool, but with the security and stability of a SaaS tool.

“We now have over ten times the amount of metrics we started with, and on different accounts. One of the great things about MetricFire is that scaling to support this increase has been hassle-free, requiring no additional work on our side.”

Maxime Audet, Cloud-Ops Team Lead, Coveo

Read customer story Customer photo of Maxime

Save valuable engineering time and stick within your budget. We're known for our predictable and transparent pricing so it's easy to keeps costs under control.

“Building and managing an on-premise installation at this scale would require a lot of engineer time, especially in the first year...we use this engineering time to work on initiatives closer to our core business”

Jim Davies, Head of DevOps, MoneySuperMarket.com

Read customer story Customer photo of Jim

Transparency is at the root of how we operate: from pricing to postmortems we're open about how we do things. We even publish our internal system metrics to our public status page.

“There’s complete transparency with everything MetricFire do which means we can accurately predict what we’ll be spending and comfortably keep within our budget.”

Itai Yaffe, Big Data Developer, Nielsen

Read customer story Customer photo of Itai

Our first line, technical support comes from engineers, for engineers. So you get highly detailed, expert support when you need it.

"Every time I have a question, I get an answer from support after just a couple of hours. Their technical knowledge is excellent.”

Shahar Kobrinsky, VP of Architecture and Scale, Eyeview

Read customer story Customer photo of Shahar

Questions?

Don’t see the integration you’re looking for? Need help setting up your monitoring? Get in touch and one of our engineers will help you out.

Contact us
You might also like other posts...
Step by Step Guide to Monitoring Apache Spark with MetricFire
metricfire Dec 06, 2024 · 6 min read

Step by Step Guide to Monitoring Apache Spark with MetricFire

Monitoring Spark metrics is crucial because it provides visibility into how your cluster and... Continue Reading

Author
Benjamin Pitts

Do more with MetricFire

Monitoring Apache Spark with MetricFire Monitoring Prometheus with MetricFire Monitoring Traefik with MetricFire Monitoring Nagios with MetricFire Monitoring RavenDB with MetricFire Monitoring Apache Zipkin with MetricFire Monitoring Apache Tomcat with MetricFire Monitoring Apache HTTP Server with MetricFire Monitoring uWSGI with MetricFire Monitoring ClickHouse with MetricFire Monitoring Jenkins with MetricFire Monitoring Kibana with MetricFire Monitoring Logstash with MetricFire Monitoring Elasticsearch with MetricFire Monitoring Riak with MetricFire Monitoring Puppet Agent with MetricFire Monitoring Cloudbees with MetricFire Monitoring Docker with MetricFire Monitoring GitLab with MetricFire Monitoring HAProxy with MetricFire Monitoring Mailchimp with MetricFire Monitoring MongoDB with MetricFire Monitoring MQTT with MetricFire Monitoring MySQL with MetricFire Monitoring NGINX with MetricFire Monitoring RabbitMQ with MetricFire Monitoring Redis with MetricFire Monitoring Azure Analysis Service with MetricFire Monitoring Azure App Service with MetricFire Monitoring Azure Arc with MetricFire Monitoring Azure Cache for Redis with MetricFire Monitoring Azure Cosmos DB with MetricFire Monitoring Azure Data Factory with MetricFire Monitoring Azure Event Grid with MetricFire Monitoring Azure Event Hubs with MetricFire Monitoring Azure Healthcare API's with MetricFire Monitoring Azure IoT Hub with MetricFire Monitoring Azure IoT Central with MetricFire Monitoring Azure Kubernetes with MetricFire Monitoring Azure MariaDB with MetricFire Monitoring Azure MySQL with MetricFire Monitoring Azure Network with MetricFire Monitoring Azure PostgreSQL with MetricFire Monitoring Azure Service Bus with MetricFire Monitoring Azure SQL with MetricFire Monitoring hipchat with MetricFire Monitoring Amazon Kinesis with MetricFire Monitoring Azure Virtual Machines with MetricFire Monitoring GCP AlloyDB with MetricFire Monitoring GCP BigQuery with MetricFire Monitoring GCP BigQuery BI Engine with MetricFire Monitoring GCP BigQuery Data Transfer with MetricFire Monitoring GCP BigQuery Storage with MetricFire Monitoring GCP Cloud Bigtable with MetricFire Monitoring GCP Cloud Functions with MetricFire Monitoring GCP Cloud Run with MetricFire Monitoring GCP Database Overview with MetricFire Monitoring GCP Compute VM Machines with MetricFire Monitoring GCP Firebase DB with MetricFire Monitoring GCP Firebase Hosting with MetricFire Monitoring Google Kubernetes Engine with MetricFire Monitoring GCP MySQL with MetricFire Monitoring GCP Network Topology with MetricFire Monitoring GCP PostgreSQL with MetricFire Monitoring GCP Memorystore for Redis with MetricFire Monitoring GCP Service Runtime with MetricFire Monitoring GCP SQLServer with MetricFire Monitoring Heroku Postgres with MetricFire Monitoring Heroku Redis with MetricFire Monitoring Heroku Kafka with MetricFire Monitoring Sitespeed with MetricFire Monitoring Telegraf with MetricFire Monitoring HG Agent with MetricFire Monitoring HiveMQ with MetricFire Monitoring Hosted StatsD with MetricFire Monitoring Microsoft Teams with MetricFire Monitoring Amazon API Gateway with MetricFire Monitoring Amazon Application ELB with MetricFire Monitoring Amazon Autoscaling Groups with MetricFire Monitoring Amazon Direct Connect with MetricFire Monitoring Amazon Container Insights with MetricFire Monitoring Amazon S3 with MetricFire Monitoring Amazon Cloudwatch Synthetics with MetricFire Monitoring Amazon Cloudwatch Logs with MetricFire Monitoring Amazon SNS with MetricFire Monitoring Amazon EC2 Spotfleet with MetricFire Monitoring SNMP Networking Devices with MetricFire Monitoring Local Area Network with MetricFire Monitoring PostgreSQL with MetricFire Monitoring Cisco NCS 5500 with MetricFire Monitoring Cisco Small Business RV Series Routers with MetricFire Monitoring Cisco's 800 Series Integrated Services Routers with MetricFire Monitoring Arris SBG8300 Gateway with MetricFire Monitoring Cisco M1140 with MetricFire Monitoring Cisco 3900 ISR with MetricFire Monitoring Cisco 3800 ISR with MetricFire Monitoring Cisco RV110W-A-NA-K9 with MetricFire Monitoring Linux Router Hardware Q330G4 with MetricFire Monitoring Cisco UC Virtual Machines with MetricFire Monitoring Chatsworth PDUs with MetricFire Monitoring On-Premise Meraki with MetricFire Monitoring Darktrace Security Tools with MetricFire Monitoring Cisco Catalyst IE3400 Rugged Series Switches with MetricFire Monitoring Cisco Rugged Series with MetricFire Monitoring Yamaha SWX3220-16MT with MetricFire Monitoring Yamaha WLX302 with MetricFire Monitoring Yamaha WLX202 with MetricFire Monitoring Yamaha WLX313 with MetricFire Monitoring Yamaha WLX413 with MetricFire Monitoring Cisco Catalyst IR1100 Rugged Series Routers with MetricFire Monitoring Datto 24-Port PoE Switch with MetricFire Monitoring Datto L8 switch with MetricFire Monitoring ADTRAN NetVanta 3205 with MetricFire Monitoring Cisco 550X Series Stackable Managed Switches with MetricFire Monitoring NVIDIA Spectrum Switches with MetricFire Monitoring Cisco Catalyst IE3200 Rugged Series Switches with MetricFire Monitoring Cisco 1900 ISR with MetricFire Monitoring Cisco 1000 Series Integrated Services Routers with MetricFire Monitoring Adtran NetVanta 1335 with MetricFire Monitoring Datto 48 Port-Switch with MetricFire Monitoring HPE Aruba Ethernet Switches with MetricFire Monitoring Cisco 2900 ISR with MetricFire Monitoring Linksys SE3024 with MetricFire Monitoring Broadcom Ethernet Switches with MetricFire Monitoring Excel with MetricFire Monitoring Datto e48 with MetricFire Monitoring Cisco ISR 4000 with MetricFire Monitoring Linksys SE3008V2 with MetricFire Monitoring Cisco SE2800 with MetricFire Monitoring Linksys SE4008 with MetricFire Monitoring Linksys SE3016 with MetricFire Monitoring Linksys LGS108 with MetricFire Monitoring Zyxel XGS1010-12 (Unmanaged) with MetricFire Monitoring Lotus Domino with MetricFire Monitoring MikroTik Routers and Switches with MetricFire Monitoring Linksys SE3005v2 with MetricFire Monitoring Cisco SE1500 with MetricFire Monitoring Linksys LGS105 with MetricFire Monitoring Cisco Industrial Ethernet 3000 Series Switches with MetricFire Monitoring Linksys SE2500 with MetricFire Monitoring TP-Link TL-SG105-M2 with MetricFire Monitoring Datto Switches with MetricFire Monitoring Linksys SE2800 with MetricFire Monitoring OmniSwitch with MetricFire Monitoring Linksys Ethernet Switches with MetricFire Monitoring TP-Link 16-Port Switch with MetricFire Monitoring Cisco Industrial Ethernet 4000 with MetricFire Monitoring NETGEAR XS508M with MetricFire Monitoring Linksys SE3008 with MetricFire Monitoring Linksys SE3005 with MetricFire Monitoring NETGEAR 16 Port Gigabit Switches with MetricFire Monitoring NETGEAR Unmanaged Switches with MetricFire Monitoring NETGEAR 8 Port PoE Switches with MetricFire Monitoring Digital Ocean with MetricFire Monitoring AWS MemoryDB with MetricFire Monitoring NETGEAR ProSafe gs105 with MetricFire Monitoring NETGEAR FS105 with MetricFire Monitoring NETGEAR ProSAFE JGS524 with MetricFire Monitoring NETGEAR gs116 with MetricFire Monitoring NETGEAR Gigabit Switches with MetricFire Monitoring NETGEAR gs605 with MetricFire Monitoring NETGEAR ProSAFE with MetricFire Monitoring NETGEAR PoE Switch with MetricFire Monitoring NETGEAR 8 port switch with MetricFire Monitoring Ubiquiti Unifi USW-Flex with MetricFire Monitoring NETGEAR gs105 with MetricFire Monitoring NETGEAR gs108 with MetricFire Monitoring NETGEAR 5 port switch with MetricFire Monitoring NETGEAR gs305 with MetricFire Monitoring NETGEAR gs308 with MetricFire Monitoring NETGEAR Ethernet Switches with MetricFire Monitoring D-Link Ethernet Switches with MetricFire Monitoring Cisco Industrial Ethernet 2000 with MetricFire Monitoring ExtremeSwitching with MetricFire Monitoring PowerConnect with MetricFire Monitoring Meraki MS 120 with MetricFire Monitoring Snowflake with MetricFire Monitoring Dataiku with MetricFire Monitoring Cisco Catalyst 9500 with MetricFire Monitoring Cisco RV260W with MetricFire Monitoring Cisco CSR with MetricFire Monitoring Cisco ISE with MetricFire Monitoring F5 BIG-IP with MetricFire Monitoring Juniper SRX with MetricFire Monitoring Juniper EX with MetricFire Monitoring EMC Isilon with MetricFire Monitoring Palo Alto with MetricFire Monitoring Fortinet Fortigate with MetricFire Monitoring Cisco Catalyst 2960 with MetricFire Monitoring HP Proliant with MetricFire Monitoring HP iLO with MetricFire Monitoring Cisco Catalyst 9300 with MetricFire Monitoring APC Smart-UPS with MetricFire Monitoring Cisco Meraki with MetricFire Monitoring Cisco ISR 4431 with MetricFire Monitoring Cisco RV345 Router with MetricFire Monitoring NetApp with MetricFire Monitoring Checkpoint-VPN-1 with MetricFire Monitoring Kubernetes with MetricFire Monitoring Codeship with MetricFire Monitoring Statuspage with MetricFire Monitoring Azure with MetricFire Monitoring Graphite with MetricFire Monitoring Amazon CloudWatch with MetricFire Monitoring Amazon Kinesis Streams with MetricFire Monitoring Amazon SQS with MetricFire Monitoring Amazon Lambda with MetricFire Monitoring Amazon DynamoDB with MetricFire Monitoring Amazon Redshift with MetricFire Monitoring Amazon Cloudfront with MetricFire Monitoring Amazon Kinesis Firehose with MetricFire Monitoring Amazon ECS with MetricFire Monitoring Amazon EMR with MetricFire Monitoring Amazon EBS with MetricFire Monitoring Amazon RDS with MetricFire Monitoring Amazon ELB with MetricFire Monitoring Amazon ElastiCache with MetricFire Monitoring Amazon EC2 with MetricFire Monitoring Amazon Route 53 with MetricFire Monitoring Amazon SES with MetricFire Monitoring Amazon EFS with MetricFire Monitoring papertrail with MetricFire Monitoring Sentry with MetricFire Monitoring New Relic with MetricFire Monitoring VictorOps with MetricFire Monitoring Graphite APIs with MetricFire Monitoring webhooks with MetricFire Monitoring Slack with MetricFire Monitoring pagerduty with MetricFire Monitoring CircleCI with MetricFire Monitoring collectd with MetricFire Monitoring OpsGenie with MetricFire Monitoring Logentries with MetricFire Monitoring Pingdom with MetricFire Monitoring GitHub with MetricFire Monitoring StatsD with MetricFire Monitoring AWS with MetricFire Monitoring Heroku with MetricFire