KQL queries to compare BI report to what is in Data Explorer

[wardjas]

I was wondering if there is a page or somewhere in the repo that has a list of all KQL queries used for the data explorer BI report? I am trying to run queries in data explorer and compare what I am seeing in my power bi report for cost summary.

For some reason using 0.7 on MCA account I am no longer seeing any subscriptions show up nor am I seeing my RI savings. When we check the box under commitment discount for Reservations everything goes to zero. Thanks for any info you may have.

Jason

[flanakin]

We could have done this for 0.7, but not for 0.8. In 0.8 the queries are generated at runtime by the Data Explorer connector. Most are just doing a summarize by whichever columns are included in the visual.

You may want to try the Data Explorer dashboard included in 0.8. Most of this works in 0.7 as well. I believe there are a few tiles that don't, so expect a few failed tiles, but the vast majority will be fine in 0.7 without updating. (Of course, we do recommend updating to get other bug fixes and improvements 😜)

I am no longer seeing any subscriptions show up

That does seem awfully suspicious. Were you on EA before? Are you missing subscriptions for reservation purchases only or are you missing cost data altogether? Using the Data Explorer dashboard, go to the Data ingestion page to see what data has been ingested. That may identify if there are any unexpected gaps.

nor am I seeing my RI savings

This sounds like prices weren't exported. Or perhaps the prices were ingested after the costs were ingested. This can happen on the first of the month (or until prices are exported for the month). If that's what you're seeing, you can re-ingest the costs by re-running the latest ingestion_ExecuteETL pipeline run that was against the Costs folder for the specific month and scope you need. I added #1326 to help with this. If it is what you're hitting, feel free to 👍 vote this up to help get it prioritized.

[wardjas]

Thanks for replying I will try the data explorer dashboard. I just blow everything away last week and have redeployed .8 from scratch this morning. I can see total savings but still when checking the box for RI only everything just goes to 0. I have tried re running the price export and re ingesting the data. We did switch from EA to MCA on Jan 2 so I think that did initially mess with my Jan numbers. So hoping with Feb I can get these ironed out. Thanks for the help.

[wardjas]

Just wanted to update that I am now seeing the RI data that was only showing 0. After I reset my Rg and redeployed it took about 24 hours for everything to show correctly. Now everything is running .8 from backend to BI reports. Also that Data explorer dashboard is amazing, thank you for that link. I do not remember seeing that in the docs.

[flanakin]

I'm guessing this is because cost data was ingested before the prices were available. When cost was ingested the next day, prices were likely already ingested. I created an issue to track this. Vote up #1326.

[flanakin]

@wardjas Where would you expect to find this in documentation? I vaguely recall adding it but I'd have to double check. If it is there, it's likely not discoverable enough. Knowing where you'd expect to find it may help.

[wardjas]

The docs look updated and I see it now. When I was looking before I was looking under the hub but I might have just missed it. The new doc look is way easier to see everything. It looks amazing. Thanks for your work on this project it has been extremely helpful.