Introduction: The Evolution of Snowflake Table Formats
In June 2024, Snowflake announced General Availability (GA) of Iceberg table support. Today in 2026, itβs matured into a critical capability for enterprises building modern lakehouses. If youβre still storing all your data in Snowflake-native format, youβre missing the flexibility and interoperability that Managed Iceberg Tables provide.
This article is a comprehensive guide to understanding, implementing, and optimizing Snowflake Managed Iceberg Tablesβbased on official Snowflake documentation and real-world best practices.
What is Apache Iceberg?
Apache Iceberg is an open-source, high-performance table format designed to manage large-scale analytical datasets. Originally created by Netflix and donated to the Apache Software Foundation, Iceberg has evolved into the industry standard for modern data lakehouses.
Key difference from traditional data lakes: Iceberg treats data as tables (with ACID guarantees), not just files in folders.
Why Iceberg Matters
| Problem | Traditional Data Lakes | Iceberg Solution |
|---|---|---|
| Concurrent reads/writes | File-based conflicts | ACID transactions |
| Schema changes | Manual rewrites | Schema evolution |
| Performance | Read entire dataset | Partition pruning + predicate pushdown |
| Time travel | Not possible | Full snapshot history |
| Multi-engine access | Data duplication | Single source of truth |
Snowflake Managed Iceberg Tables: Whatβs Different?
Snowflake introduced two types of Iceberg table support:
1. Snowflake-Managed Iceberg Tables β (Recommended)
What it means: Snowflake manages the catalog, metadata, and coordination.
Characteristics:
- β Full read/write access
- β Full ACID transactions
- β Native Snowflake features (time travel, CLONE, etc.)
- β Performance parity with native Snowflake tables
- β Automatic metadata management
- β Supported by all Snowflake features (Cortex AI, Iceberg optimization, etc.)
Storage: Data lives in your S3, GCS, or Azure Storage (you pay cloud provider)
2. Externally-Managed Iceberg Tables
What it means: External system (AWS Glue, Delta Lake, etc.) manages metadata.
Characteristics:
- β Read-only access from Snowflake
- β Can write from external engines
- β 2x better performance than external tables
- β Limited Snowflake feature support
- β Manual refresh required
Use case: Query datasets managed by Spark/Databricks while others write to them.
Architecture: How Snowflake Managed Iceberg Tables Work
Three-Layer Architecture
βββββββββββββββββββββββββββββββββββββββββββββββ
β Catalog Layer β
β (Snowflake manages metadata pointers) β
β - Table names & locations β
β - Current metadata file pointers β
β - Atomic metadata updates β
ββββββββββββββββββ¬βββββββββββββββββββββββββββββ
β
β¦The remaining 16 lines stay in the interactive article so this page remains a written walkthrough rather than a raw code dump.
Key insight: Snowflake manages catalog & metadata. You manage data storage costs (billed by cloud provider).
Snowflake Managed Iceberg vs. Native Tables: Real Performance Comparison
Snowflake-managed Iceberg tables perform at parity with Snowflake native tables while storing data in public cloud storage.
Performance Metrics (2026)
| Metric | Native Table | Snowflake-Managed Iceberg | External Table | Externally-Managed Iceberg |
|---|---|---|---|---|
| Query Speed | Baseline | 98-100% | 40-50% | 80-90% |
| Write Speed | Baseline | 98-100% | N/A | N/A |
| Storage Location | Snowflake | Your cloud | Your cloud | Your cloud |
| Storage Cost | Snowflake (expensive) | Cloud provider (cheaper) | Cloud provider (cheaper) | Cloud provider (cheaper) |
| Read-Write | Full | Full | Read-only | Read/Limited write |
Reality: If query performance is your only concern, go native. If cost matters, Managed Iceberg wins.
Setting Up Snowflake Managed Iceberg Tables
Step 1: Create External Volume
The external volume is the connection between Snowflake and your cloud storage.
AWS S3:
SQL example β read the query, then copy it into your warehouse.
-- Create external volume for Iceberg tablesCREATE OR REPLACE EXTERNAL VOLUME iceberg_storage STORAGE_LOCATIONS = (('s3://my-bucket/iceberg/', ROLE_ARN = 'arn:aws:iam::123456789012:role/snowflake-role')); -- Verify connectionDESC EXTERNAL VOLUME iceberg_storage;
Google Cloud Storage:
SQL example β read the query, then copy it into your warehouse.
CREATE OR REPLACE EXTERNAL VOLUME iceberg_gcs STORAGE_LOCATIONS = (('gs://my-bucket/iceberg/', GCS_ACCESS_TOKEN = 'YOUR_TOKEN'));
Azure Blob Storage:
SQL example β read the query, then copy it into your warehouse.
CREATE OR REPLACE EXTERNAL VOLUME iceberg_azure STORAGE_LOCATIONS = (('azure://mycontainer/iceberg/', AZURE_SAS_TOKEN = 'YOUR_SAS_TOKEN'));
Step 2: Create an Iceberg Table
Option A: Create empty Iceberg table
sql
SQL example β read the query, then copy it into your warehouse.
-- Create managed Iceberg table in SnowflakeCREATE OR REPLACE ICEBERG TABLE my_iceberg_data ( customer_id INT, customer_name VARCHAR, email VARCHAR, signup_date DATE, lifetime_value DECIMAL(10, 2))CATALOG = 'SNOWFLAKE'EXTERNAL_VOLUME = 'iceberg_storage'PARTITION BY (DATE_TRUNC('MONTH', signup_date));
Option B: Create from existing data
SQL example β read the query, then copy it into your warehouse.
-- Convert native table to IcebergCREATE OR REPLACE ICEBERG TABLE customer_iceberg ASSELECT * FROM snowflake_native_table;
Option C: Convert existing Iceberg table from external catalog
Code example β copy the snippet, then match it to your project.
-- Convert externally-managed to Snowflake-managed-- No data rewrite, just metadata conversionALTER ICEBERG TABLE external_iceberg_tableCONVERT TO MANAGED CATALOG;
Step 3: Load Data
-- Insert data
INSERT INTO my_iceberg_data VALUES
(1, 'John Doe', '[email protected]', '2024-01-15', 5000.00),
(2, 'Jane Smith', '[email protected]', '2024-02-20', 8500.00);
-- Bulk load with COPY INTO
COPY INTO my_iceberg_data
FROM @stage_name/file.parquet
β¦The remaining 9 lines stay in the interactive article so this page remains a written walkthrough rather than a raw SQL dump.
Step 4: Query the Iceberg Table
-- Standard SQLβno difference
SELECT
customer_name,
COUNT(*) as purchase_count,
AVG(lifetime_value) as avg_value
FROM my_iceberg_data
WHERE signup_date >= '2024-01-01'
GROUP BY customer_name;
β¦The remaining 9 lines stay in the interactive article so this page remains a written walkthrough rather than a raw SQL dump.
Real-World Use Cases
Use Case 1: Multi-Engine Analytics
Problem: Data team uses Snowflake, ML team uses Spark, Analytics team uses Dbt/SQL.
Solution: Single Iceberg table, multiple compute engines.
-- Create table in Snowflake
CREATE OR REPLACE ICEBERG TABLE ml_features (
feature_id INT,
feature_name VARCHAR,
feature_value FLOAT,
created_date TIMESTAMP
)
CATALOG = 'SNOWFLAKE'
β¦The remaining 11 lines stay in the interactive article so this page remains a written walkthrough rather than a raw SQL dump.
Benefits:
- β Single source of truth
- β No data duplication
- β Concurrent reads/writes (ACID guarantees)
- β 50% storage savings vs. duplicate tables
Use Case 2: Cost Optimization (Iceberg vs. Native)
Scenario: 10TB customer data table, mostly queried for recent data.
Native Snowflake Table:
- Storage cost: 10TB Γ $23/TB/month = $230/month
- Compute (queries): $50/month
- Total: $280/month
Managed Iceberg Table:
- Storage cost: 10TB Γ $0.023/GB (S3 standard) = $230/month (to cloud provider, not Snowflake)
- Compute (Snowflake): $50/month
- Total: $280/month cost, butβ¦
- Snowflake storage is gone (massive long-term savings)
- Cloud storage is cheaper if using Intelligent-Tiering
- Performance is identical
Real savings: Over 2 years, 30-40% reduction by moving to Iceberg.
Use Case 3: Time Travel & Compliance
Scenario: Financial data needs 7-year audit trail with point-in-time reconstruction.
-- Create Iceberg table with retention
CREATE OR REPLACE ICEBERG TABLE transactions (
txn_id INT,
account_id INT,
amount DECIMAL,
txn_date TIMESTAMP
)
EXTERNAL_VOLUME = 'compliance_storage'
β¦The remaining 15 lines stay in the interactive article so this page remains a written walkthrough rather than a raw SQL dump.
Benefits:
- β Full audit trail
- β Regulatory compliance
- β Immediate point-in-time recovery
- β No separate backup infrastructure
Pricing: How Much Do Managed Iceberg Tables Cost?
What Snowflake Charges You
| Service | Cost |
|---|---|
| Compute (queries) | Standard warehouse rates (1 credit = $2-4 per second of compute) |
| Cloud Services | Typically 10-20% overhead on compute |
| Automatic Clustering | Optional, billed separately if enabled |
| Snowpipe | Credits for data loading |
| Cross-region data transfer | $0.02-0.10/GB depending on regions |
What Cloud Provider Charges You
| Provider | Cost |
|---|---|
| AWS S3 storage | $0.023/GB/month (standard tier) |
| Google Cloud Storage | $0.020/GB/month |
| Azure Blob | $0.0184/GB/month |
Real Cost Example: 10TB Iceberg Table
Monthly costs:
Snowflake (compute + services):
- 1,000 queries Γ 2 credits avg = 2,000 credits
- 2,000 credits Γ $3/credit = $6,000/month
Cloud Storage (S3):
- 10TB Γ $0.023/GB = 10,240GB Γ $0.023 = $235/month
β¦The remaining 12 lines stay in the interactive article so this page remains a written walkthrough rather than a raw YAML dump.
Optimization: Getting the Most Out of Managed Iceberg Tables
Optimization 1: Set Target File Size
Snowflake automatically compacts files, but you can guide it:
-- Optimize for query performance
ALTER ICEBERG TABLE my_iceberg_data
SET (ICEBERG_CONFIG = '{
"write.target-file-size-bytes": 134217728 -- 128MB, default for balance
}');
-- For smaller frequent updates
SET (ICEBERG_CONFIG = '{
β¦The remaining 7 lines stay in the interactive article so this page remains a written walkthrough rather than a raw code dump.
Optimization 2: Partitioning Strategy
-- Good: Partition by frequently filtered column
CREATE ICEBERG TABLE events (
event_id INT,
user_id INT,
event_type VARCHAR,
event_date DATE,
event_time TIMESTAMP
)
β¦The remaining 6 lines stay in the interactive article so this page remains a written walkthrough rather than a raw SQL dump.
Optimization 3: Use Automatic Clustering (Optional)
-- Enable auto-clustering on hot columns
ALTER ICEBERG TABLE my_iceberg_data
CLUSTER BY (customer_id, signup_date);
-- Check clustering quality
SELECT
table_name,
clustering_key,
β¦The remaining 5 lines stay in the interactive article so this page remains a written walkthrough rather than a raw SQL dump.
Cost: Automatic Clustering is billed separately at ~0.5-2 credits per GB/day reorganized. Use only for frequently queried columns.
Optimization 4: Remove Orphan Files
Failed transactions sometimes leave orphan Parquet files in cloud storage (tracked but unreferenced).
-- Check for orphan files (manual process)
-- Snowflake doesn't auto-remove them yet
-- Use this to identify storage waste:
SELECT
table_name,
active_bytes,
retained_bytes,
β¦The remaining 6 lines stay in the interactive article so this page remains a written walkthrough rather than a raw SQL dump.
Snowflake Managed Iceberg vs. Alternatives
vs. Native Snowflake Tables
| Aspect | Iceberg | Native |
|---|---|---|
| Performance | Equal (parity) | Equal (parity) |
| Storage location | Your cloud | Snowflake owned |
| Storage cost | Cloud provider | Snowflake (3x more) |
| Time Travel | Snapshots | Up to 90 days |
| Multi-engine | Yes (Spark, Dbt, etc.) | No |
| Schema evolution | Native support | Requires ALTER |
| Setup complexity | Medium (needs external volume) | Low |
| When to use | Cost-sensitive, multi-engine | Performance-first, Snowflake-only |
vs. External Tables
| Aspect | Iceberg | External Tables |
|---|---|---|
| Performance | 2x better | Baseline |
| Write support | Full | No (read-only) |
| ACID | Yes | No |
| Time Travel | Yes | No |
| Supported formats | Parquet only | CSV, Avro, ORC, Parquet |
| Setup | Medium | Simple |
| Use case | Modern lakehouse | Legacy data lake query |
Common Gotchas & Solutions
Gotcha 1: Cross-Cloud/Cross-Region Not Supported
Problem: You canβt create Iceberg table with S3 storage while Snowflake account is in Azure.
SQL example β read the query, then copy it into your warehouse.
-- β This will failCREATE ICEBERG TABLE cross_cloud_table (...)EXTERNAL_VOLUME = 'aws_s3_volume'; -- Error if in Azure -- β
Use same cloud as account-- If you really need cross-cloud, use catalog integration instead
Solution: Keep Snowflake and storage in same cloud region, or use Catalog Integration for cross-cloud.
Gotcha 2: Orphan File Accumulation
Problem: Failed transactions leave behind Parquet files you still pay storage for.
SQL example β read the query, then copy it into your warehouse.
-- Monitor storage metricsSELECT table_name, DATEDIFF(day, last_modified, current_date) as days_since_update, active_bytes, retained_bytesFROM ACCOUNT_USAGE.TABLE_STORAGE_METRICSWHERE TABLE_TYPE = 'ICEBERG' AND database_name = 'your_db'; -- If gap between active_bytes and retained_bytes, contact Snowflake Support
Solution: Snowflake is working on auto-cleanup. Until then, monitor and contact support if discrepancies appear.
Gotcha 3: Refresh Required for Externally-Managed Tables
Problem: Changes from external systems (Spark, Delta) arenβt immediately visible.
SQL example β read the query, then copy it into your warehouse.
-- For externally-managed tables only:ALTER ICEBERG TABLE external_table REFRESH; -- Set up automated refreshCREATE TASK refresh_external_table WAREHOUSE = compute_wh SCHEDULE = '5 MINUTES'AS ALTER ICEBERG TABLE external_table REFRESH;
Solution: Always refresh before querying externally-managed Iceberg tables. Or use Snowflake-managed (no refresh needed).
Real-World Implementation Checklist
1: Planning (Week 1)
- Identify tables for Iceberg migration (large, multi-access)
- Calculate current storage costs
- Choose cloud storage (S3, GCS, Azure)
- Plan partition strategy
- Identify multi-engine requirements
2: Setup (Week 2-3)
- Create cloud storage bucket
- Set up IAM roles/permissions
- Create external volume in Snowflake
- Create test Iceberg table
- Load sample data (1% of production)
- Run performance benchmarks
3: Migration (Week 4-6)
- Create Iceberg tables (use CREATE AS SELECT)
- Validate data integrity
- Update ETL pipelines
- Update queries (usually no changes needed)
- Monitor performance & costs
- Archive old native tables (donβt delete yet)
4: Optimization (Ongoing)
- Monitor storage costs
- Review partition effectiveness
- Enable automatic clustering if needed
- Set up orphan file monitoring
- Plan for multi-engine access
Key Takeaways
- Snowflake-managed Iceberg tables are production-ready β GA since June 2024, widely adopted
- Performance is identical to native tables β No trade-off
- Storage costs are lower β Cloud provider rates beat Snowflake
- Multi-engine access enabled β Spark, Dbt, other engines can use same data
- Time travel & ACID built-in β Full transaction guarantees
- External volume is required β Setup takes 15 minutes
- Pricing is predictable β Compute (Snowflake) + Storage (cloud provider)
- Not a magic bullet β Only migrate if you have specific use cases (cost, multi-engine, flexibility)
External References (Official Snowflake Docs)
- Apache Iceberg Tables Documentation
- Managing Iceberg Tables
- Catalog Integration Setup
- External Volumes Configuration
- Snowflake Engineering Blog: Managed Iceberg Tables
- Unifying Iceberg Tables on Snowflake
Next Steps
- Assess your tables β Which ones would benefit from Iceberg?
- Create an external volume β Takes 15 minutes
- Run a pilot β Create Iceberg table from 1% of production data
- Benchmark β Compare performance with native table
- Plan migration β Identify production timeline
- Scale gradually β Donβt convert everything at once
Disclaimer: Information current as of January 2026. Always verify with official Snowflake documentation for latest features and capabilities. Pricing and features subject to change.
Questions this article answers
Short answers first. Open a question to read the working note.
Can Spark write to Snowflake-managed Iceberg tables?
Not directly via Spark. Snowflake-managed catalog is Snowflake-exclusive. But Spark can read them:
What's the performance overhead of Iceberg?
Zero. Snowflake-managed Iceberg tables perform at parity with native Snowflake tables.
