Skip to content

[Power BI] Read gzip-compressed CSV exports in storage reports - #2386

Merged
Roland Krummenacher (RolandKrummenacher) merged 2 commits into
devfrom
RolandKrummenacher/storage-reports-gzip-exports
Oct 28, 2026
Merged

Roland Krummenacher (RolandKrummenacher) merged 2 commits into
devfrom
RolandKrummenacher/storage-reports-gzip-exports

Conversation

@RolandKrummenacher

Copy link
Copy Markdown
Collaborator

Summary

Storage reports connected directly to Cost Management exports show no data when the export uses gzip-compressed CSV (part_0_0001.csv.gz).

In ftk_Storage, the raw export filter (FilterExpData) only kept files with the .parquet or .csv extension. Power Query reports .gz as the extension of *.csv.gz, so these files were filtered out before ReadContent, which already decompresses .gz files. The result was an empty table with no error, because the _dataNotFound() fallback row is commented out.

Changes

  • Added .gz to the raw export extension filter in src/power-bi/storage/Shared.Dataset/definition/expressions.tmdl.
  • Added a changelog entry under Unreleased > Power BI reports > Fixed.

Hub storage (ingestion container) is not affected; it only contains parquet.

Testing

  • Refresh a storage report against a FOCUS cost export configured with gzip CSV and confirm data loads.

🤖 Generated with Claude Code

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟢 Approval recommended

No active review issues are reported for the change allowing Power BI storage reports to include gzip-compressed Cost Management exports.

No open issues 🎉

What changed in this PR

This PR allows Power BI storage reports to pass gzip-compressed Cost Management CSV exports to the existing decompression logic instead of filtering them out.

Changes:

  • Adds .gz to the accepted raw export extensions alongside .parquet and .csv.
  • Documents the fix in the unreleased changelog and updates its date.
File Description
src/​power-bi/​storage/​Shared.Dataset/​definition/​expressions.tmdl Includes .gz files in the raw export filter.
docs-mslearn/​toolkit/​changelog.md Adds the Power BI fix entry and updates ms.date.

Review effort: Balanced

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🤖 [AI][Claude] PR Review

Summary: No blockers. The filter fix is correct: ReadContent already decompresses .gz files before the .csv branch, so the filter was the only gap.

⚠️ Should fix (1)

  1. The changelog entry is in Unreleased, but the v15 prep PR restructures that file. Move it into the v15 section.

💡 Suggestions (1)

  1. Trim the changelog entry to the user-visible fix.

Comment thread docs-mslearn/toolkit/changelog.md Resolved
Comment thread docs-mslearn/toolkit/changelog.md Resolved
The raw export file filter in ftk_Storage only kept .parquet and .csv
files, so Cost Management exports configured with gzip compression
(part_*.csv.gz, extension .gz) were dropped and the reports showed no
data. ReadContent already decompresses .gz files; let them through.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@RolandKrummenacher
Roland Krummenacher (RolandKrummenacher) force-pushed the RolandKrummenacher/storage-reports-gzip-exports branch from 220ff36 to 611615c Compare October 28, 2026 15:42
@RolandKrummenacher
Roland Krummenacher (RolandKrummenacher) merged commit 5445feb into dev Oct 28, 2026
7 checks passed
@RolandKrummenacher
Roland Krummenacher (RolandKrummenacher) deleted the RolandKrummenacher/storage-reports-gzip-exports branch October 28, 2026 15:50
Michael Flanakin (flanakin) added a commit that referenced this pull request Oct 28, 2026
Adds dev's #2377, #2378, and #2386 to the v15 changelog and notes that the Public sensitivity label is only needed when labels are enabled.

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>

This branch was successfully deployed

1 active deployment
ftk-pr — 611615c7 Deployed Oct 28, 2026 by RolandKrummenacher via Clean up PR resources #87
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Needs: Review 👀 PR that is ready to be reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants