Skip to content
techfura

All about Tech and Data Engineering

  • Home
  • About Us
  • Courses
  • Blog
  • Contact
  • Services

Category: Azure

Using Azure Data Lake to copy data from CSV file to a SQL database

January 29, 2021January 29, 2021 Kenneth_pro_

Great, but what is Azure Data Lake? Azure Data Lake includes all the capabilities required to make it easy for developers, data scientists, and analysts to store data of any size, shape, and speed, and do all types of processing and analytics Read More …

ADF, AzureLeave a comment

U-SQL (Intro)

December 15, 2020December 15, 2020 Kenneth_pro_

U-SQL is a language that unifies the benefits of SQL with the expressive power of your own code to process all data at any scale. U-SQL’s scalable distributed query capability enables you to efficiently analyze data in the store and Read More …

ADLA, Azure, USQLLeave a comment

Including File Properties and Metadata in a U-SQL Script

September 18, 2020September 18, 2020 Kenneth_pro_

U-SQL adds support for computed file property columns on EXTRACT statement. Sometimes customers would like to get information about the files that they process, such as the full URI path or information about size, creation or modification dates. Likewise customers would Read More …

ADLA, USQLADLA, U_SQL File Metadata, U-SQL, USQLLeave a comment

U-SQL Table

September 16, 2020September 16, 2020 Kenneth_pro_

Azure Data Lake Analytics (U-SQL) originates from the world of Big Data, in which data is processed in a scale-out manner by using multiple nodes. These nodes can access the data in several formats, from flat files to U-SQL tables. Read More …

ADLA, Programming, USQLADLA, Azure, Big Data, U-SQL, U-SQL Table, USQLLeave a comment

Data Factory Ingestion Framework: Part 1 – Schema Loader

May 13, 2020May 13, 2020 Kenneth_pro_

Use Case A business wants to utilize cloud technology to enable data science and augment data warehousing by staging and prepping data in a data lake. There are multiple different systems we want to pull from, both in terms of Read More …

ADF, AzureLeave a comment

T-SQL TO U-SQL DATA TYPE CONVERSION

May 13, 2020May 13, 2020 Kenneth_pro_

When working with code generated solutions we often need to convert datasets from SQL Server (T-SQL) data types to Azure Data Lake Analytics (U-SQL) data types. As you probably know U-SQL has a hybrid syntax of T-SQL and C# which Read More …

ADLA, Azure, USQLLeave a comment

Part 9: Extending U-SQL

May 13, 2020May 13, 2020 Kenneth_pro_

There are 5 kinds of User-Defined entities in U-SQL User-Defined Functions (UDFs) User-Defined Types (UDTs) User-Defined Aggregators (UDAggs) User-defined Operators (UDOs) User-Defined Appliers All of them are defined by .NET code. C# is not required. Any .NET language will work. User-Defined Functions User defined functions are normal static methods Read More …

ADLA, Azure, USQLLeave a comment

Part 8: Set operations and Joins

May 13, 2020 Kenneth_pro_

Set operations are a way of merging rowsets together based on set theoretic operations such as union (UNION). intersection (INTERSECT), complement (EXCEPT). Sample data Let’s define two RowSets: @a and @b. Notice that both RowSets have duplicate rows. UNION UNION combines two rowsets. UNION Read More …

ADLA, Azure, USQLLeave a comment

Part 7: Window Functions

May 13, 2020May 13, 2020 Kenneth_pro_

Window functions were introduced to the ISO/ANSI SQL Standard in 2003. U-SQL adopts a subset of window functions as defined by the ANSI SQL Standard. Window functions are used to do computation within sets of rows called windows. Windows are defined Read More …

ADLA, Azure, USQLLeave a comment

Part 6: The U-SQL Catalog and Assemblies

May 13, 2020May 13, 2020 Kenneth_pro_

The U-SQL Catalog is the way U-SQL organizes data and code for re-use and sharing. Catalog organization Every ADLA account has a single U-SQL catalog. The catalog cannot be deleted. Each U-SQL catalog contains one or more U-SQL databases. Every Read More …

ADLA, Azure, USQLLeave a comment

Posts navigation

Older posts

Categories

  • Azure (21)
    • ADF (4)
    • ADLA (13)
      • USQL (13)
    • Azure Services (1)
    • Azure SQL (2)
    • Data and Analytics (1)
  • Azure Databricks (1)
  • ETL/ELT (1)
    • SSIS (1)
  • Excel (2)
    • Functions (1)
    • Split csv Files (1)
  • Programming (29)
    • C# (5)
    • HTML/CSS (3)
    • JavaScript (6)
    • TSQL (14)
      • Built-in Functions (3)
      • Data Conversion (1)
      • Errors (2)
      • Indexes (1)
      • Merge Statement (1)
      • Mostly Asked Questions (3)
      • Stored Procedure and UDF (3)
  • Reporting (2)
    • SSRS (2)
February 2021
M T W T F S S
1234567
891011121314
15161718192021
22232425262728
« Jan    

Recent Posts

  • Using Azure Data Lake to copy data from CSV file to a SQL database
  • SQL MERGE statement
  • Split huge CSV files – Open in Excel
  • A Stored Procedure to generate a random token
  • U-SQL (Intro)

Traffic Counts

PHP Hits Count
© 2021 Techfura All rights reserved.