+

Monitoring AWS with Amazon Redshift

Integrating AWS and Amazon Redshift with your monitoring system

To integrate AWS and Amazon Redshift with your monitoring system, please reach out to MetricFire. Book a demo with the MetricFire team to discuss integrating AWS and Amazon Redshift and how that can support your monitoring system.

What is AWS?

Amazon Web Services (AWS) is a platform that provides a multitude of services. AWS provides more than 175 different services such as computing, storage, networking, database, analytics, application services, deployment, management, mobile, developer tools, and tools for the Internet of Things. 

 

You can build, host, run, and monitor your software entirely within AWS. AWS eliminates the need for developers and businesses to have their servers, databases, or networks. 

 

AWS is the world’s biggest and most widely adopted cloud platform. It has completely changed how web applications are built, and the nature of DevOps and SRE work.

 

There are many options for doing performance monitoring for applications built in AWS. AWS provides a monitoring tool called CloudWatch that automatically pulls in metrics from all areas of your application. However, using CloudWatch for everything can become very expensive.

 

If you’re monitoring a small application, CloudWatch will be suitable for your monitoring needs. However, if you’re monitoring a massive application with lots of custom metrics, the cost of monitoring with CloudWatch quickly escalates beyond reasonable.

 

Monitoring your AWS with MetricFire is a great option for reducing the cost of your monitoring and for getting better functionality. MetricFire can pull your metrics directly from AWS and put them into a custom AWS monitoring dashboard. MetricFire can alert on these metrics and can send notifications directly to your phone, email, or Slack. 

 

To get started, first, create a policy that we will later attach to the user.

  1.  In the IAM Dashboard, click on Policies (on the left) or Customer Managed Policies under IAM Resources, then click on Create Policy.
  2. Switch to the JSON tab, replace the existing text with the policy provided below, and click ‘Review policy‘.
  3. Give the policy a name (Eg: HG_policy) and a description (optional).
  4. Save the policy by clicking ‘Create Policy‘.

 

Next, we’ll create a user to attach the policy. We’ll use the Access Key/Secret Key tokens to permit Hosted Graphite to import CloudWatch metric data.

  1.  In the IAM Console, click on ‘Users‘ on the left or under IAM Resources. Then select ‘Add User‘.
  2. Give the user a name (Eg: HG_addon) and ‘Programmatic access‘ for the Access type.
  3. Click ‘Next: Permissions‘ and click the ‘Attach existing policies directly‘ button at the top.
  4. Search for the policy we just created and attach it by clicking the corresponding checkbox, then press ‘Next: Review‘.
  5. Click on ‘Create User‘ and copy the Access Key and Secret Key into the relevant fields on the add-on set-up page here. Optionally, you can download a copy of this account information, but keep it safe as this information can be sensitive.

  

To enable the CloudWatch add-on, go to the add-ons page in your Hosted Graphite account and choose the option for Amazon AWS CloudWatch. From there you can select the AWS services you wish to connect with.

spaces_ZtHmoGZNsmARIViZEdbz_uploads_2...

 

spaces_ZtHmoGZNsmARIViZEdbz_uploads_n...

  

If you have any questions about getting your AWS instances connected to Hosted Graphite, contact our team. We're happy to help you!

What is Amazon Redshift?

Collect and Forward Redshift Metrics from AWS Cloudwatch

MetricFire has an easy to use integration that pulls metrics from the Cloudwatch API, and forwards them to a Hosted Graphite account. You can configure this integration in a few simple steps:



  1. In your Hosted Graphite account, navigate to Add-Ons => AWS and +Add an AWS account by entering your Access key and Secret key.
  2. Now you can select which AWS services to pull metrics from, and even enable metric tagging (optional). Learn more about our AWS integration in the Hosted Graphite Cloudwatch docs.
  3. You can also name the account you've configured. This is recommended, especially if you are configuring multiple AWS accounts like dev, stage, and prod.
  4. Depending on your enabled AWS services and internal permissions settings, you might need to add our default AWS Policy to your IAM user to allow us to pull metrics from your AWS account.
  5. Metrics should be hitting your Hosted Graphite account within about 10 minutes. You can use these metrics to create custom Dashboards and Alerts, and you'll notice that some new dashboards have been automatically created in your HG account. We also have a handy AWS Overview dashboard that can be found in our Dashboard Library, which offers a great starting point.



aws-config



aws-dash



If you have any issues with configuring this integration, or need to integrate with a service that is not currently listed, please contact our team. We will be happy to help you out, and develop new AWS integrations for you!

What is MetricFire?

MetricFire is a full-scale platform that provides infrastructure, system, and application monitoring using a suite of open-source tools. We will aggregate and store your data as time series metrics, which can be used to build custom dashboards and alerts. MetricFire takes away the burden of self-hosting your own monitoring solution, allowing you more time and freedom to work on your most important tasks.

 

     hg-main-page

         

 

MetricFire offers a complete ecosystem of end-to-end infrastructure monitoring, comprised of open-source Graphite and Grafana. MetricFire handles the aggregation, storage, and backups of your data, and offers alerting, team features, and API's for easy management of your monitoring environment. You can send server metrics using one of our agents, custom metrics from within your application code, and integration metrics from a variety of popular 3rd party services that we integrate with like Heroku, AWS, Azure, GCP, and many more!

         

Our Hosted Graphite product has improved upon standard Graphite to add data dimensionality, optimized storage, and offers additional tools and features that provide customers with a robust and well-rounded monitoring solution.

       

Benefits of Using MetricFire:

  • Simple, low-cost pricing
    A structured pricing model based on total unique time series metrics allows you to work within your budget. The predictability and transparent pricing allows you to keep your costs in check and plan for the future. 1 metric is 1 metric regardless of the source, or requests sent to and from the metric namespace.
  • Easy-to-use dashboards
    Our Hosted Dashboards provide endless options for customizing your visualizations, and allow you to share dashboards with clients.
  • Responsive alerting
    Receive alert notifications quickly through Email, PagerDuty, Slack, Microsoft Teams, OpsGenie, and custom webhooks.
  • Freedom of customization
    Send custom application metrics through your code. Our Language Guide can help you update your codebase to send event metrics via socket connections.
  • Fantastic customer support
    Fast and friendly support is provided by engineers, for engineers, to get you set up quickly. Start a conversation with us through the chat bubble below!
  • Enterprise-ready
    Dedicated clusters for users that need their own environment with custom parameters. Please reach out to us for more information.
      
The author for this testimonial, Jim Davies, Head of DevOps, MoneySuperMarket.com.
“As MetricFire scales effortlessly, we can push and store more metrics than we really need today but might need tomorrow. This increases our depth of understanding of the systems that we run and heads off any future problems.”
Jim Davies, Head of DevOps, MoneySuperMarket.com.

Don't just take our word for it

Why thousands of engineers choose us:

fingerprint icon Own your data
dollar icon Major savings
eye icon Nothing hidden
face icon Engineering support

Vendor lock-in's not our thing. We’re believers in you still owning your data, so you can request a full export at any time. That means you get all the benefits of an open-source tool, but with the security and stability of a SaaS tool.

“We now have over ten times the amount of metrics we started with, and on different accounts. One of the great things about MetricFire is that scaling to support this increase has been hassle-free, requiring no additional work on our side.”

Maxime Audet, Cloud-Ops Team Lead, Coveo

Read customer story Customer photo of Maxime

Save valuable engineering time and stick within your budget. We're known for our predictable and transparent pricing so it's easy to keeps costs under control.

“Building and managing an on-premise installation at this scale would require a lot of engineer time, especially in the first year...we use this engineering time to work on initiatives closer to our core business”

Jim Davies, Head of DevOps, MoneySuperMarket.com

Read customer story Customer photo of Jim

Transparency is at the root of how we operate: from pricing to postmortems we're open about how we do things. We even publish our internal system metrics to our public status page.

“There’s complete transparency with everything MetricFire do which means we can accurately predict what we’ll be spending and comfortably keep within our budget.”

Itai Yaffe, Big Data Developer, Nielsen

Read customer story Customer photo of Itai

Our first line, technical support comes from engineers, for engineers. So you get highly detailed, expert support when you need it.

"Every time I have a question, I get an answer from support after just a couple of hours. Their technical knowledge is excellent.”

Shahar Kobrinsky, VP of Architecture and Scale, Eyeview

Read customer story Customer photo of Shahar

Questions?

Don’t see the integration you’re looking for? Need help setting up your monitoring? Get in touch and one of our engineers will help you out.

Contact us
You might also like other posts...
metricfire Dec 06, 2024 · 6 min read

Step by Step Guide to Monitoring Apache Spark with MetricFire

Monitoring Spark metrics is crucial because it provides visibility into how your cluster and... Continue Reading

Do more with MetricFire