SYS-CON MEDIA Authors: Elizabeth White, Liz McMillan, Yeshim Deniz, Roger Strukhoff, Jason Bloomberg

Blog Feed Post

How to Build a Grafana Dashboard with Node-RED & InfluxDB

In this final part of our Node-RED integration blog series, I will be covering how you can accelerate your website performance monitoring strategy by building a custom dashboard using the popular open data visualization platform, Grafana.

We will be using Node-RED to act as the endpoint for the Test Data Webhook, which will parse and inject the payload into InfluxDB, which Grafana will then query to build the dashboard. Grafana supports a number of data sources by default, but for this exercise, InfluxDB is used.

The Node-RED portion of this implementation is actually very simple, and to make things even easier, you can grab a skeleton flow directly from GitHub and import this into Node-RED. You will need to install the InfluxDB node in Node-RED.

This is done by going to ‘manage palette,’ selecting the install tab, and searching for InfluxDB.

http://blog.catchpoint.com/wp-content/uploads/2018/01/Node-RED-integrati... 300w" sizes="(max-width: 766px) 100vw, 766px" />

The imported flow creates an endpoint and an extract, transform, and load function into InfluxDB.

This will need to be updated to reflect your InfluxDB configuration. The node defaults to http://127.0.0.1:8086 and a database name of ‘Catchpoint.’

http://blog.catchpoint.com/wp-content/uploads/2018/01/Node-RED-workflow-... 300w" sizes="(max-width: 746px) 100vw, 746px" />

It’s necessary that your Node-RED instance is a public endpoint so the Test Data Webhook can POST data.

InfluxDB and Grafana do not need to be publically exposed; I’ve used Docker to run both as containers on my Mac.

A fresh installation of InfluxDB doesn’t have any databases so you will need to create one. You’ll also need to connect to the InfluxDB instance and create a database:

http://blog.catchpoint.com/wp-content/uploads/2018/01/Node-RED-database-... 300w" sizes="(max-width: 600px) 100vw, 600px" />

You can now configure the Test Data Webhook to point to your new endpoint running in Node-RED and the database will start to populate. The ETL flow in Node-RED will inject data into three new measurements, test_counter, test_byte and test_timing.

The ETL function can easily be edited to suit your own needs by including additional metrics over the ones already defined.

Login into Grafana and from the main menu, select ‘Data Sources.’ Add a new data source and complete the details for your own instance.

http://blog.catchpoint.com/wp-content/uploads/2018/01/Node-RED-integrati... 300w" sizes="(max-width: 743px) 100vw, 743px" />

http://blog.catchpoint.com/wp-content/uploads/2018/01/How-to-integrate-N... 300w" sizes="(max-width: 714px) 100vw, 714px" />

An example JSON schema for a dashboard is available on GitHub; copy this to your clipboard. From the Dashboards menu, select the sub-menu item ‘Import.’ Paste the contents of your clipboard into the ‘Or paste JSON’ text area and click ‘Load.’

http://blog.catchpoint.com/wp-content/uploads/2018/01/Importing-Catchpoi... 300w, http://blog.catchpoint.com/wp-content/uploads/2018/01/Importing-Catchpoi... 750w" sizes="(max-width: 751px) 100vw, 751px" />

The dashboard will default to the name ‘Catchpoint,’ so just click Import to continue.

If you have data in InfluxDB, you will see the dashboard display data. The screenshot below is the example dashboard showing last seven days of data for a given test for all nodes.

http://blog.catchpoint.com/wp-content/uploads/2018/01/Catchpoint-perform... 300w, http://blog.catchpoint.com/wp-content/uploads/2018/01/Catchpoint-perform... 768w" sizes="(max-width: 770px) 100vw, 770px" />

If all is working well, you can do a direct comparison with data views from within the Catchpoint portal.

http://blog.catchpoint.com/wp-content/uploads/2018/01/Performance-graph-... 300w" sizes="(max-width: 747px) 100vw, 747px" />

Using tools that work well together is a key element of a sound website performance monitoring strategy, which is why we continue to frequently add new integrations.

If you have any suggestions, feedback, or comments regarding our integration capabilities, please feel free to reach out to [email protected], or start a discussion in our new User Community if you’re already a user.

 

If you’d like to learn more about our integrations and website performance monitoring solutions, check out our website.

The post How to Build a Grafana Dashboard with Node-RED & InfluxDB appeared first on Catchpoint's Blog - Web Performance Monitoring.

Read the original blog entry...

More Stories By Mehdi Daoudi

Catchpoint radically transforms the way businesses manage, monitor, and test the performance of online applications. Truly understand and improve user experience with clear visibility into complex, distributed online systems.

Founded in 2008 by four DoubleClick / Google executives with a passion for speed, reliability and overall better online experiences, Catchpoint has now become the most innovative provider of web performance testing and monitoring solutions. We are a team with expertise in designing, building, operating, scaling and monitoring highly transactional Internet services used by thousands of companies and impacting the experience of millions of users. Catchpoint is funded by top-tier venture capital firm, Battery Ventures, which has invested in category leaders such as Akamai, Omniture (Adobe Systems), Optimizely, Tealium, BazaarVoice, Marketo and many more.

Latest Stories
Tapping into blockchain revolution early enough translates into a substantial business competitiveness advantage. Codete comprehensively develops custom, blockchain-based business solutions, founded on the most advanced cryptographic innovations, and striking a balance point between complexity of the technologies used in quickly-changing stack building, business impact, and cost-effectiveness. Codete researches and provides business consultancy in the field of single most thrilling innovative te...
Atmosera delivers modern cloud services that maximize the advantages of cloud-based infrastructures. Offering private, hybrid, and public cloud solutions, Atmosera works closely with customers to engineer, deploy, and operate cloud architectures with advanced services that deliver strategic business outcomes. Atmosera's expertise simplifies the process of cloud transformation and our 20+ years of experience managing complex IT environments provides our customers with the confidence and trust tha...
CloudEXPO has been the M&A capital for Cloud companies for more than a decade with memorable acquisition news stories which came out of CloudEXPO expo floor. DevOpsSUMMIT New York faculty member Greg Bledsoe shared his views on IBM's Red Hat acquisition live from NASDAQ floor. Acquisition news was announced during CloudEXPO New York which took place November 12-13, 2019 in New York City. Our Silicon Valley 2019 schedule will showcase 200 keynotes, sessions, general sessions, power panels, and...
With the introduction of IoT and Smart Living in every aspect of our lives, one question has become relevant: What are the security implications? To answer this, first we have to look and explore the security models of the technologies that IoT is founded upon. In his session at @ThingsExpo, Nevi Kaja, a Research Engineer at Ford Motor Company, discussed some of the security challenges of the IoT infrastructure and related how these aspects impact Smart Living. The material was delivered interac...
ShieldX's CEO and Founder, Ratinder Ahuja, believes that traditional security solutions are not designed to be effective in the cloud. The role of Data Loss Prevention must evolve in order to combat the challenges of changing infrastructure associated with modernized cloud environments. Ratinder will call out the notion that security processes and controls must be equally dynamic and able to adapt for the cloud. Utilizing four key factors of automation, enterprises can remediate issues and impro...
Intel is an American multinational corporation and technology company headquartered in Santa Clara, California, in the Silicon Valley. It is the world's second largest and second highest valued semiconductor chip maker based on revenue after being overtaken by Samsung, and is the inventor of the x86 series of microprocessors, the processors found in most personal computers (PCs). Intel supplies processors for computer system manufacturers such as Apple, Lenovo, HP, and Dell. Intel also manufactu...
Darktrace is the world's leading AI company for cyber security. Created by mathematicians from the University of Cambridge, Darktrace's Enterprise Immune System is the first non-consumer application of machine learning to work at scale, across all network types, from physical, virtualized, and cloud, through to IoT and industrial control systems. Installed as a self-configuring cyber defense platform, Darktrace continuously learns what is ‘normal' for all devices and users, updating its understa...
As you know, enterprise IT conversation over the past year have often centered upon the open-source Kubernetes container orchestration system. In fact, Kubernetes has emerged as the key technology -- and even primary platform -- of cloud migrations for a wide variety of organizations. Kubernetes is critical to forward-looking enterprises that continue to push their IT infrastructures toward maximum functionality, scalability, and flexibility. As they do so, IT professionals are also embr...
The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time to wait for long development cycles that produce software that is obsolete at launch. DevOps may be disruptive, but it is essential. DevOpsSUMMIT at CloudEXPO expands the DevOps community, enable a wide sharing of knowledge, and educate delegates and technology providers alike.
At CloudEXPO Silicon Valley, June 24-26, 2019, Digital Transformation (DX) is a major focus with expanded DevOpsSUMMIT and FinTechEXPO programs within the DXWorldEXPO agenda. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive over the long term. A total of 88% of Fortune 500 companies from a generation ago are now out of business. Only 12% still survive. Similar percentages are found throug...
Industry after industry is under siege as companies embrace digital transformation (DX) to disrupt existing business models and disintermediate their competitor’s customer relationships. But what do we mean by “Digital Transformation”? The coupling of granular, real-time data (e.g., smartphones, connected devices, smart appliances, wearables, mobile commerce, video surveillance) with modern technologies (e.g., cloud native apps, big data architectures, hyper-converged technologies, artificial in...
OpsRamp is an enterprise IT operation platform provided by US-based OpsRamp, Inc. It provides SaaS services through support for increasingly complex cloud and hybrid computing environments from system operation to service management. The OpsRamp platform is a SaaS-based, multi-tenant solution that enables enterprise IT organizations and cloud service providers like JBS the flexibility and control they need to manage and monitor today's hybrid, multi-cloud infrastructure, applications, and wor...
CloudEXPO has been the M&A capital for Cloud companies for more than a decade with memorable acquisition news stories which came out of CloudEXPO expo floor. DevOpsSUMMIT New York faculty member Greg Bledsoe shared his views on IBM's Red Hat acquisition live from NASDAQ floor. Acquisition news was announced during CloudEXPO New York which took place November 12-13, 2019 in New York City.
The Master of Science in Artificial Intelligence (MSAI) provides a comprehensive framework of theory and practice in the emerging field of AI. The program delivers the foundational knowledge needed to explore both key contextual areas and complex technical applications of AI systems. Curriculum incorporates elements of data science, robotics, and machine learning-enabling you to pursue a holistic and interdisciplinary course of study while preparing for a position in AI research, operations, ...
Codete accelerates their clients growth through technological expertise and experience. Codite team works with organizations to meet the challenges that digitalization presents. Their clients include digital start-ups as well as established enterprises in the IT industry. To stay competitive in a highly innovative IT industry, strong R&D departments and bold spin-off initiatives is a must. Codete Data Science and Software Architects teams help corporate clients to stay up to date with the mod...