In a recent blog post, Microsoft’s corporate vice president of the Data Group, Joseph Sirosh, has outlined what to expect from the new and expanded Azure Data Lake that makes big data processing and analytics simpler and more accessible.
“Azure Data Lake includes the Azure Data Lake Store, a single repository where you can easily capture data of any size, type and speed, Azure Data Lake Analytics, a new service built on Apache YARN that dynamically scales so you can focus on your business goals, not on distributed infrastructure, and Azure HDInsight, our fully managed Apache Hadoop cluster service. Azure Data Lake is an important part of the Cortana Analytics Suite and a key component of Microsoft’s big data and advanced analytics portfolio,” he explained.
The Azure Data Lake service includes U-SQL, a language that unifies the benefits of SQL with the expressive power of user code. “U-SQL’s scalable distributed query capability enables you to efficiently analyze data in the store and across SQL Servers in Azure, Azure SQL Database and Azure SQL Data Warehouse,” Sirosh said. “Customers can use Azure Data Lake tools for Visual Studio, which simplifies authoring, debugging and optimisation and provides an integrated development environment for analytics.”
ASOS.com, the UK's largest independent online fashion and beauty retailer, has been using Azure Data Lake to improve the customer experience. “At ASOS we are committed to putting the customer first. As a global fashion destination for 20-somethings we need to stay abreast of customer behaviour on our site, enabling us to optimise their shopping experience across all platforms of ASOS.com and wherever they are in the world. Microsoft Azure Data Lake Analytics assists in processing large amounts of unstructured clickstream data to track and optimize their experience. We have been able to get productive immediately using U-SQL because it was easy to use, extend and view and monitor the jobs all within Visual Studio” said Rob Henwood, Enterprise Architect at ASOS.com.”