Magento Cloud: Fastly dashboard in NewRelic

Monitoring your e-commerce infrastructure plays a key role in improving performance and service availability. While investigating excessive usage of CDN traffic, I missed detailed information that is offered by competition (such as Cloudflare). I followed the Fastly documentation on setting up a Log Streaming from Fastly to NewRelic.

That did not work.

I have submitted Support Ticket to Adobe.

Log Streaming is a service offered by New Relic on their own. Supporting any 3rd party service falls out of scope of Adobe Support. Although, I would recommend you to generate new keys, and try again. If it still doesn’t work, please get in touch with your development team, or with NewRelic’s support team. – Technical Support Engineer, Adobe Commerce

Adobe Commerce gives you very limited access to Fastly and NewRelic. There is no access to Fastly dashboard, and even if they create a NewRelic account for you – it does not have enough permissions to create Ingress License Key (API Key required for log streaming).

In the Adobe Commerce Cloud environment, direct access to the Fastly dashboard is not provided. Changes to the Fastly configuration will need to be done through the Adobe Commerce admin panel, or users can secure the API credentials and use the Fastly API for changes: https://experienceleague.adobe.com/en/docs/commerce-on-cloud/user-guide/cdn/setup-fastly/fastly-configuration#test-fastly-credentials – Technical Support Engineer, Adobe Commerce

Recycling Adobe’s data

Magento Cloud employees claim they can’t configure Log Streaming or give you sufficient permissions for you to configure it on your own. The truth is: Adobe Support already use log streaming for their internal use. You just need to listen to their data, instead of following Fastly documentation.

1. Log in to your Adobe Commerce admin panel, proceed to Stores > Settings > Configuration in the menu, then expand Advanced section to access System configuration.
2. In the Full Page Cache group, you’ll find sub-group Fastly Configuration. Expand the Tools group to gain access to Real-Time Log Streaming sub-group.
3. Lookg closer at the Endpoints section. You should notice mc_nr is there.

Click on the ⚙️ cog next to this endpoint and review the Log Format:

Comparing that to the previously installed Fastly Dashboard in NewRelic, you should notice similarities:

This way, you can map the expected attributes with their corresponding data keys. The problem starts with numeric values – for example client_resp_ttfb or client_resp_body_size_write. Adobe employees stream these as… string. Which makes it unable to aggregate data correctly.

Fortunately, NewRelic predicted that beginners could make such a mistake in data mapping and they have introduced numeric() function, that converts strings into numbers (float).

Download Fastly Dashboard for NewRelic

You don’t need to reinvent the wheel. You can download Fastly dashboard and install to your NewRelic.

If you’re not sure how to import JSON file as a Dashboard, follow the NewRelic documentation.