Azure SQL Data Warehouse is an enterprise-class distributed database in the Azure Cloud capable of processing up to petabyte volumes of relational and non-relational data. It is the industry's first cloud data warehouse with grow, shrink, and pause in seconds.
2
votes
2answers
36 views
Azure Data Warehouse PolyBase File format
We have a file that looks like this:
Col1,Col2,Col3,Col4,Col5
"Hello,",I,",am",some,data!
It therefore has the following 'properties':
Comma-separated
Double-quote column delimiter
Commas in some ...
0
votes
2answers
40 views
SQL Data Warehouse - unale to create table-valued functions
Background:
I am migrating a SQL Server datawarehouse to Azure SQL Data Warehouse. The database is the source for an SSAS OLAP cube.
Some of the measure groups have been partitioned and rely on a ...
0
votes
1answer
37 views
sqlcmd on Azure SQL Data Warehouse - SqlState 24000, Invalid cursor state after INSERT statement
I am working on a script to reload a table using SQLCMD on Linux connecting to an Azure SQL Data Warehouse database.
After the INSERT statement completes, the next statement fails (but does not end ...
0
votes
3answers
63 views
Azure Sql DataWareHouse API
Is there a REST API for Azure Sql Datawarehouse? Like API for creating server, table etc.
I don't see anything in the documentation https://azure.microsoft.com/en-us/documentation/articles/sql-data-...
0
votes
1answer
66 views
azure dw limit error
I scheduled around 70 concurrent queries using 70 logins to stress test Azure DW (DWU 200) and after a while started getting this error
[Execute SQL Task] Error: Executing the query "SELECT Distinct ...
1
vote
2answers
100 views
Azure Data Warehouse - Not using all available DWU's
My organisation is currently evaluating Azure Datawarehouse. We have a fact table that contains 16M rows and another that has 5M both of them are hash distributed on the same column (same data type ...
3
votes
3answers
89 views
Time-based drilldowns in Power BI powered by Azure Data Warehouse
I have designed a simple Azure Data Warehouse where I want to track stock of my products on periodic basis. Moreover I want to have an ability to see that data grouped by month, weeks, days and hours ...
2
votes
2answers
108 views
SQL Azure Data warehouse Dynamic SQL Select query
In Azure SQL Data Warehouse stored procedure I try to form Dynamic SQL and perform select query,I unable to fetch the resutSet
Below is code Snippet:
DECLARE @sql nvarchar(400)
DECLARE @cnt int
BEGIN
...
1
vote
2answers
108 views
Azure SQL Data Warehouse “Impacted RowCount”
In SQL Azure DB when update statement is executed,we can get the impacted row count by @@ROWCOUNT, similarly in Azure SQL Data Warehouse I am unable to get the impacted Row Count. Is there a way to ...
1
vote
1answer
42 views
Error deploying SQL Data Warehouse
I'm trying to deploy a new empty SQL DW on a Brazil South Server and keep getting the same error:
{
"status": "Failed",
"error": {
"code": "ResourceDeploymentFailure",
"message": "A ...
1
vote
1answer
67 views
How to provide row updates to table in Azure SQL DW using SSDT?
How can I implement automated row updates using SSDT for table in AZURE SQL Datawarehouse? When I try using the OLEDB Command component I receive an error :
An OLE DB record is available. Source: ...
3
votes
1answer
136 views
Handling embedded new lines when creating/selecting External Tables in SQL Data Warehouse
In SQL Data Warehouse (editors please don't change this, it is the actual name see: here) I have a JobCandidate_ext external table that looks like this.
CREATE EXTERNAL TABLE [HumanResources].[...
2
votes
1answer
67 views
Avoiding name collisions when creating external tables on SQL Server datawarehouse
I am trying to migrate a database AdventureWorks using Polybase to SQL Server datawarehouse.
Suppose I have a schema HumanResources and a table Department in that schema.
CREATE TABLE [...
5
votes
1answer
195 views
Optimal SSIS data flow settings to load to stage table in Azure SQL DW
I have a 350MB table that's fairly wide with two varchar(2000) columns. Via an SSIS data flow it takes 60 minutes to load via OLEDB "fast load" destination to Azure SQL DW. I changed the destination ...
1
vote
2answers
152 views
Azure SQL Data Warehouse
It would be nice if I know the various ways to load data into Azure SQL Data Warehouse.
I could connect to Azure SQL DW using JDBC from my Ubuntu machine.
Is there any direct way to load from ...
1
vote
1answer
154 views
Microsoft Azure sql data warehouse supported in Informatica
I want to do simple transformation with source as Flat file and target as SQL Data Warehouse.In target Analyser using ODBC Connection I am able to connect the SQL Data Warehouse and connection is ...
2
votes
1answer
98 views
Azure SQL Data Warehouse: No catalog entry found for partition ID <id> in database <id>. The metadata is inconsistent. Run DBCC CHECKDB
I am working on moving stored procedures from an on-prem SQL Server database to an Azure SQL Data Warehouse (ASDW). Throughout the process I have had to work around a few missing features - time ...
1
vote
1answer
84 views
Connect to Azure SQL Data Warehouse from Mac OS X
I'm trying to connect to Azure SQL Data Warehouse from the command line on my MacBook with sql-cli. With the following connection string, the login just hangs ("Connecting to .database.windows.net...."...
1
vote
3answers
358 views
Can't View Code or Script out Stored Procedures or Tables In Azure SQL Data Warehouse
Is there functionality in Azure SQL Data Warehouse similar to SQL Server's right-click -> Modify in SSMS for stored procedures?
Is there functionality in Azure SQL Data Warehouse similar to SQL ...
1
vote
1answer
71 views
Cross server restore for Azure SQL DW?
Let's say I have a mydev.database.windows.net Azure SQL Server and Azure SQL DW database for development. And I have a myprod.database.windows.net for prod. If I want to restore prod to dev (cross ...
3
votes
1answer
173 views
Azure SQL Data Warehouse and Entity Framework
Does anybody know if/when we will be able to use Entity Framework with the Azure SQL Data Warehouse? I have searched high and low and cannot seem to find anything other than a question posted on MSDN ...
2
votes
1answer
41 views
Invalid object name - system created object
I wonder if anyone can enlighten me as to the underlying cause of Azure SQL DW errors like this:
ErrorMsg: [Microsoft][ODBC Driver 11 for SQL Server][SQL Server]Invalid object name 'Distribution_8....
3
votes
3answers
345 views
Azure SQL Data Warehouse Surrogate Keys
So Azure SQL Data Warehouse doesn't support identity columns, and therefore it's tricky to deal with surrogate keys.. anyone got any bold solutions on this one?
This is best i have found, and it's ...
3
votes
2answers
623 views
How to calculate Azure SQL Data Warehouse DWU?
I am analyzing Azure SQL DW and I came across the term DWU (Data warehouse units). The link on Azure site only mentions a crude definition of DWU. I want to understand how DWU is calculated and how ...
4
votes
1answer
238 views
Azure SQL Data Warehouse and PolyBase can't read CSV files generated using U-SQL and ADLA
I have a U-SQL script that generates a CSV file in Azure storage and an external table in Azure SQL Data Warehouse (SDW) using PolyBase to read that CSV file.
When the CSV file is generated using the ...
2
votes
1answer
98 views
Azure SQL Data Warehouse bandwidth limits?
Are there any bandwidth limits or throttling for Azure SQL Data Warehouse extracts? Are there any connection string settings that optimize how fast we can extract data via a SELECT query?
From SSIS ...
1
vote
1answer
45 views
Force CETAS to only write one file?
If I run a CREATE EXTERNAL TABLE AS SELECT * FROM DistributedTable, then I end up with 60 files in blob storage. If I do CREATE EXTERNAL TABLE AS SELECT * from sys.objects, I get one file in blob ...
1
vote
2answers
63 views
Azure SQL DW storage cost is for used storage not max DB size?
If I create a new Azure SQL DW from the portal, it starts off with a max size of 10TB (and autogrow off, I believe). If I then load only 10GB of data am I paying for 10TB of storage or only ~10GB? ...
1
vote
2answers
103 views
Azure SQL DW CTAS of over 102,400 rows to one distribution doesn't automatically compress
I thought the way columnstores worked was that if you bulk load over 102,400 rows into one distribution of a columnstore, it would automatically compress it. I'm not observing that in Azure SQL DW.
I'...
2
votes
4answers
92 views
Calculate Sum From Moving 4 Rows in SQL
I've have the following data.
WM_Week POS_Store_Count POS_Qty POS_Sales POS_Cost
------ --------------- ------ -------- --------
201541 3965 77722 153904.67 102593....
1
vote
1answer
94 views
Data loading concurrency limits in Azure SQL DW
In PDW, you can have 10 loads running concurrently and up to 40 queued, then the 51st will fail. What about for Azure SQL DW?
This page mentions the DWU/concurrency numbers. Does data loading (...
2
votes
1answer
92 views
BroadcastMove in Azure SQL DW
Since Azure SQL DW doesn't currently have replicated tables, what exactly happens during a BroadcastMove? Does one temp table per compute node get created and populated with the results of broadcast? ...
4
votes
1answer
179 views
How does Azure SQL DW know the row count without statistics?
If I run a CREATE EXTERNAL TABLE cetasTable AS SELECT command then run:
EXPLAIN
select * from cetasTable
I see in the distributed query plan:
<operation_cost cost="4231.099968" ...
1
vote
2answers
373 views
How to load to Azure SQL Data Warehouse data stored as JSON in Azure Blobs?
I have a bunch of data stored as JSON file in Azure Blobs. I want to load them into Azure SQL Data Warehouse, but Azure SQL Data Warehouse does not seem to accept JSON input files.
What is the best ...
2
votes
1answer
322 views
Azure SQL Data Warehouse - Slow LEFT JOIN with temporary table
I run a very simple Query (see below) in my "Azure SQL Data Warehouse" and it takes 5 seconds. If I run the same Query in "Azure SQL Server" it takes 0 seconds which seems more normal. (This Query is ...
1
vote
1answer
139 views
BCP Error Numeric value out of range when importing multi-line file to Azure SQL Data Warehouse
I'm trying to load my Azure SQL Data Warehouse using the bcp utility but have been running into issue after issue...I finally got a .txt file with one record to import successfully, but now when I put ...
2
votes
1answer
308 views
Issue connecting to Azure SQL Data Warehouse
I'm having an issue connecting to an Azure SQL Data Warehouse instance from within a corporate firewall.
I can connect to the server itself (i.e. the master database), and can telnet to both the ...
-1
votes
1answer
184 views
Sync and transform data from Azure SQL Database to SQL Data Warehouse
I want to sync and transform (every 30 minutes) data from Azure SQL Database to SQL Data Warehouse. What is the best practices? I can't use SSIS on azure, Data FActory, or Sql Sync can do it?
1
vote
1answer
347 views
Azure SQL DW deadlock inside DMS
We are getting deadlocks inside DMS at least 30% of the time or more on several of the larger sprocs which truncate and insert several million rows. However, there is only one query running, so I don'...
2
votes
1answer
314 views
Unable to create EXTERNAL TABLE to Azure SQL Server on Azure SQL Data Warehouse
Unable to create EXTERNAL TABLE at Azure SQL Data Warehouse pointing to Azure SQL Server.
CREATE EXTERNAL DATA SOURCE EX_SOURCE
WITH (
TYPE = RDBMS,
LOCATION = 'SERVER.database.windows.net',
...
3
votes
1answer
66 views
Type of Databases on Azure SQL Data Warehouse
Is there a way to look at catalog data to determine if the database is an Azure SQL Data Warehouse Database?
For example, I have an initial database I've created via Azure, however I've found I can ...
2
votes
2answers
2k views
Recommended tools to ETL data from Azure SQL Database to Azure SQL Data Warehouse? [closed]
I have a requirement to build a data warehouse using Azure SQL Data Warehouse, sourced with data from a single Azure SQL Database. Looking at this article, it seems I have two options:
SSIS
Azure ...
2
votes
1answer
44 views
PDW System Views Missing from Master Database
System views such as sys.pdw_table_distribution_properties are missing from the master database. The database which I created when I created my instance of SQL Data Warehouse has these views. Why ...
0
votes
1answer
100 views
AAD authentication supported for Azure SQL DW currently?
It looks like Azure Active Directory authentication is in preview for Azure SQL Database. Is it also in preview for Azure SQL Data Warehouse or is it currently supported?
https://azure.microsoft.com/...
1
vote
1answer
479 views
Using SQL Server Management Studio against Azure SQL Data Warehouse
I am aware that I can use SSDT in VS to connect to Azure SQL DW, but if I try and use SSMS, I run into two issues
the "No Count" issue when opening a new query window
Tables are not displayed in the ...
4
votes
1answer
332 views
Polybase create external datasource giving syntax error
I'm trying to execute the following command in Azure Data Warehouse:
CREATE EXTERNAL DATA SOURCE Brand WITH (TYPE=HADOOP, LOCATION ='wasbs://brand@mywarehouse.blob.core.windows.net' CREDENTIAL = ...
1
vote
1answer
136 views
Escaping quotes in Polybase with STRING_DELIMITER
I've got a pipe delimited flat file I want to load with Polybase. String columns are quoted with double quotes and if there are double quotes in the value, they are doubled. I believe that's a valid ...
4
votes
3answers
728 views
Azure SQL Data Warehouse ''NoCount' Error
I just got approved for the Azure SQL Data Warehouse Preview, and just finished "provisioning" my new server and database. I followed a link to a 'Getting Started' page from Microsoft (Get started: ...
1
vote
2answers
429 views
Cannot connect to Azure SQL Data Warehouse database-error “Incorrect syntax near 'ANSI_NULLS'”
I could successfully deliver the new Azure SQL Data Warehouse database.
If Í try to connect to the SQL Data Warehouse Database, I receive following error message:
"Parse error at line: 1 ,column: 5: ...
3
votes
1answer
409 views
Real-time data synchronization from Azure database to Azure SQL Data Warehouse?
I've done a fair bit of reading and it seems like there are a couple of off-the-shelf products that replicate/sync data from on-premise database to Azure SQL Data Warehouse but I've found nothing that ...
Related Tags
azure × 43
sql-azure × 17
data-warehouse × 15
sql × 12
sql-server × 8
ssis × 3
java × 2
powerbi × 2
more related tags
Hot Network Questions
- Why do modern computer cases still have USB 2.0 ports?
- Are there any ice hockey movies where the team loses the big game?
- One Encryption, Many Decryption Keys
- The Benefits/Disadvantages of using a credit card
- Why are so many American (spy) movies set in Europe?
- Can we use science to explain a creature that feeds on emotion?
- Print word containing string and first word
- "To death" vs "to the death"
- At the end of Star Trek Beyond, how did Uhura know who Krall was?
- Would it be rude to ask a famous professor who doesn't know me personally for a recommendation letter if I have published in a high ranking journal?
- How to make Changes (Edit Core Block) in a Block in Magento 2
- Trying to find the name of this fantasy series so I can finish it
- Why do many countries in the world still require citizens of states with a high HDI to get visas?
- What is the purpose of delayed suspend (Ctrl-Y) in Bash?
- Mapping the far side of the galaxy
- Is "faff" well understood outside Britain?
- If time travel is possible in the future, no matter how distant, why haven't they come back to tell us?
- Judging sincerity of freelance job offers
- How can I pass filenames with spaces as arguments?
- Timing Belt need replacing? Unknown mileage
- Are GPT partitions less likely to get corrupted than MBR-based partitions?
- Can you retrieve a discarded item in No Mans Sky?
- How to return a fake watch "gifted" by a client
- Is there a more elegant way to write this statement?
