Ingress and Egress Fees

Ingress and egress fees refer to the cost of data transfer into and out of the cloud.

• Ingress fees are typically zero - allowing users to upload data to Amazon S3 or Azure Blob Storage with no additional charge. 
• Egress fees are typically charged when data exits the cloud. These fees can differ significantly between providers and source and destination region.

Hosting on S3 will set you back $0 for 1 GB download per month, and around 1000 downloads of a 50MB file will cost you just under $5 a month.

AWS S3 (and Auth Methods) for Azure Folks

Amazon S3 is something akin to Azure Blob Storage. 

A quick revision of Azure Blob Storage: 

Azure Blob Storage is a general-purpose cloud storage option for cloud native workloads.  

It supports WORM operating scenarios (Write Once Read Many) aka WORM-compliant storage (which prevents data from being edited or deleted). Role based access control (RBAC) is supported as is authentication with Microsoft Entra (formerly Azure Active Directory).

Amazon S3 (Simple Storage Service) is a similar offering in AWS.

The services are exposed as a web service with a custom HTTP scheme known as keyed-HMAC (Hash Message Authentication Code).  A more "high level" authentication option is available via AWS IAM.

LLM Training Data

LLMs are trained on large data sets.  One such data set is Common Crawl which consists of 250 billion Internet pages with 3-5 billion pages added each month.  This is petabytes worth of data (1 petabyte = 10^15 bytes of digital information). The data is stored on Amazon's S3 service allowing direct download or access for Map-Reduce processing in EC2.