The INTJ Billing Bitcoin Lightning Network Grafana Dashboard
Posted 10 months ago by CHILLYCALENDAR
Hi Everyone,
I hope you're all well.
I wanted to let you all know about some work I have been doing recently with Grafana which may be of interest to you as fellow node runners.
Using Grafana and the forwarding logs from my RTL instance I have created a public dashboard of my primary Bitcoin Lightning Network node CHILLYCALENDAR (which is currently the 3rd highest ranked node in terms of capacity in Australia and the highest ranked in Melbourne thanks to you, my amazing fellow node runners and this fantastic website). My dashboard contains a connect now button which links to a lightning page on my website where other node runners can easily connect to my node and open channels. I might add an additional button that links to this website as well.
The dashboard can be seen at this link: https://grafana.intjbilling.com/d/ba0e94bc-3b0c-465f-bab6-fc640da6997b/chillycalendar-node-statistics?orgId=1
I was greatly inspired by the dashboard that LQWD the publicly listed Lightning Network company in Canada developed. I became aware of their dashboard when they opened a channel to my node recently. My dashboard is a work in progress and it could use some further refinements but I think most of the basics are there.
As most of you will know, creating dashboards like this for Bitcoin and the Bitcoin Lightning Network at the moment is quite difficult. It will get easier as more developers build tools which automate a lot of the programming, configuration and integration work I had to do to get all this working.
I used Grafana with a MariaDB. I exported the forwarding data from RTL, populated the database, connected it up to Grafana as a data source and then created the dashboards. I utilised ChatGPT as well for some of the queries. At the moment it's a manual process to export the forwarding logs from RTL and import them into MariaDB but I have reached out to the developers of RTL to find out the MySQL queries they use on the underlying lightning sqlite database to form the view and CSV file from RTL. I did look at the underlying schema of the sqlite db but I thought it would be better to reach out to the RTL devs directly and find out exactly how they do it. My Grafana instance has been set up on another VPS and not on CHILLYCALENDAR. I created a new A record on my webhost for grafana.intjbilling.com and pointed it to my VPS where I have Grafana running. That VPS is running Apache with a number of virtual hosts one of which is Grafana.
As we know Bitcoin is a pseudo anonymous open public ledger. Public dashboards like these I think can give regulators more confidence in those of you who like myself are running lightning network digital exchanges.
If any of you as my fellow node runners would like more details about how I did this and would like to set up a similar dashboard for your nodes or would like to collaborate with me on improving and refining my dashboard so we can come up with an even better one by working together on it please do feel free to reach out to me and I'll provide you with all the code and details.
I have also been hard at work recently populating links at the bottom section of my website https://intjbilling.com/index.html some of those links will be of interest to you as fellow node runners as they make it easier for us to run our nodes keeping access to all the important websites in the one place for quick access.
Almost everything I'm doing with lightning is open source and free for you all. Just reach out to me if you see anything I have done that you like and I'll provide it to you.
With Very Best Regards,
Clarke
Clarke Towson, BCMS (Bachelor of Computer & Mathematical Science)
I hope you're all well.
I wanted to let you all know about some work I have been doing recently with Grafana which may be of interest to you as fellow node runners.
Using Grafana and the forwarding logs from my RTL instance I have created a public dashboard of my primary Bitcoin Lightning Network node CHILLYCALENDAR (which is currently the 3rd highest ranked node in terms of capacity in Australia and the highest ranked in Melbourne thanks to you, my amazing fellow node runners and this fantastic website). My dashboard contains a connect now button which links to a lightning page on my website where other node runners can easily connect to my node and open channels. I might add an additional button that links to this website as well.
The dashboard can be seen at this link: https://grafana.intjbilling.com/d/ba0e94bc-3b0c-465f-bab6-fc640da6997b/chillycalendar-node-statistics?orgId=1
I was greatly inspired by the dashboard that LQWD the publicly listed Lightning Network company in Canada developed. I became aware of their dashboard when they opened a channel to my node recently. My dashboard is a work in progress and it could use some further refinements but I think most of the basics are there.
As most of you will know, creating dashboards like this for Bitcoin and the Bitcoin Lightning Network at the moment is quite difficult. It will get easier as more developers build tools which automate a lot of the programming, configuration and integration work I had to do to get all this working.
I used Grafana with a MariaDB. I exported the forwarding data from RTL, populated the database, connected it up to Grafana as a data source and then created the dashboards. I utilised ChatGPT as well for some of the queries. At the moment it's a manual process to export the forwarding logs from RTL and import them into MariaDB but I have reached out to the developers of RTL to find out the MySQL queries they use on the underlying lightning sqlite database to form the view and CSV file from RTL. I did look at the underlying schema of the sqlite db but I thought it would be better to reach out to the RTL devs directly and find out exactly how they do it. My Grafana instance has been set up on another VPS and not on CHILLYCALENDAR. I created a new A record on my webhost for grafana.intjbilling.com and pointed it to my VPS where I have Grafana running. That VPS is running Apache with a number of virtual hosts one of which is Grafana.
As we know Bitcoin is a pseudo anonymous open public ledger. Public dashboards like these I think can give regulators more confidence in those of you who like myself are running lightning network digital exchanges.
If any of you as my fellow node runners would like more details about how I did this and would like to set up a similar dashboard for your nodes or would like to collaborate with me on improving and refining my dashboard so we can come up with an even better one by working together on it please do feel free to reach out to me and I'll provide you with all the code and details.
I have also been hard at work recently populating links at the bottom section of my website https://intjbilling.com/index.html some of those links will be of interest to you as fellow node runners as they make it easier for us to run our nodes keeping access to all the important websites in the one place for quick access.
Almost everything I'm doing with lightning is open source and free for you all. Just reach out to me if you see anything I have done that you like and I'll provide it to you.
With Very Best Regards,
Clarke
Clarke Towson, BCMS (Bachelor of Computer & Mathematical Science)
CEO
INTJ Billing
m: +61 432 359 166
a: 7 Cullen Court Spotswood Victoria 3015 AUSTRALIA
Bitcoin Lightning Network Node Name: CHILLYCALENDAR
Node Public Key: 025124c73ef7ecf527e0114ead02a0cc6e3ecbc0c99474ee3f5506c4503b089693
Status Page: https://intjbilling.com/INTJBillingStatusPage.php
2 Comments
schulzemic wrote 9 months ago
I did something similar using the forwarding data from LNDG with their postgresql backend and found it very easy to extract the data with Grafana, with a query such as:
SELECT forward_date as time, amt_out_msat / 1000 as outgoing_amt_sat, 1000000000 * fee / amt_out_msat as fee_ppm, chan_in_alias as Incoming, chan_out_alias as Outgoing from gui_forwards
SELECT forward_date as time, amt_out_msat / 1000 as outgoing_amt_sat, 1000000000 * fee / amt_out_msat as fee_ppm, chan_in_alias as Incoming, chan_out_alias as Outgoing from gui_forwards
WHERE $__timeFilter(forward_date)
CHILLYCALENDAR wrote 8 months ago
Thank you for that advice very much appreciated. I will look into doing it that way.
Best Regards,
Clarke
Best Regards,
Clarke
Please login to post comments.
Lightning Network Node
CHILLYCALENDAR
Rank: 7 / Silver
Capacity: 285,267,173 SAT
Channels: 95
Latest news
Chillycalendar and Chillycalendar 2 are back online!
Posted 3 months ago
Chillycalendar and Chillycalendar 2 are currently down due storm damage
Posted 3 months ago