Clarify Parquet continuous export performance for wide tables#2900
Conversation
|
@silasmendes-ms : Thanks for your contribution! The author(s) and reviewer(s) have been notified to review your proposed change. |
|
Learn Build status updates of commit 7f8d684: ✅ Validation status: passed
For more details, please refer to the build report. |
|
Hi @silasmendes-ms - This pull request was opened in the public repo. PMs should work in the private repo, per the Microsoft Docs contributor guide. We can keep this PR open for review and merge, but would you make future content updates in the private repo? Thank you! Can you review the proposed changes? Important: When the changes are ready for publication, adding a #label:"aq-pr-triaged" |
prmerger-automator
Bot
added
the
aq-pr-triaged
There was a problem hiding this comment.
Pull request overview
Documents a known limitation in Azure Data Explorer continuous export behavior by noting that exporting to Parquet may see reduced performance on very wide tables, helping set expectations for customers designing schemas and export pipelines.
Changes:
- Added a limitation note about Parquet continuous export performance for tables with many columns.
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
|
#sign-off |
…s://github.com/MicrosoftDocs/dataexplorer-docs (branch main) (#7548) * Clarify Parquet continuous export performance for wide tables (#2900) * Clarify Parquet continuous export performance for wide tables * Potential fix for pull request finding Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com> --------- Co-authored-by: Silas Mendes <silasmendes@gmail.com> Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com> * Implement resource ID retrieval for Azure authentication (#2918) * Implement resource ID retrieval for Azure authentication Added code to fetch resource ID from metadata for Azure Data Explorer authentication. * Update authenticate-with-msal.md * Refactor resource ID retrieval to C# Updated the method for fetching resource ID from Kusto service metadata, switching from Java to C# code. * Clarify MSAL authentication support for ingest endpoint Updated the code sample to clarify that the MSAL authentication flow is supported for the 'ingest-' endpoint. --------- Co-authored-by: learn-build-service-prod[bot] <113403604+learn-build-service-prod[bot]@users.noreply.github.com> Co-authored-by: Silas Mendes <61285023+silasmendes-ms@users.noreply.github.com> Co-authored-by: Silas Mendes <silasmendes@gmail.com> Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com> Co-authored-by: Learn Build Service GitHub App <Learn Build Service LearnBuild@microsoft.com> Co-authored-by: ohad bitton <32278684+ohadbitt@users.noreply.github.com>
Adds a limitation note documenting that continuous export to Parquet can experience reduced performance for tables with a large number of columns due to per-column encoding overhead.
This clarification helps set customer expectations around export performance characteristics for wide tables.