Data Model
There are only three core concepts you need to know.
- Files are the top level object for storing data. A
File
can store raw data and an ordered list ofBlocks
. - Blocks are chunks of content within a
File
. They can contain raw data and/or text, and an unordered set ofTags
. - Tags are typed annotations on a
Block
orFile
.
The following diagram shows how data is created and used within Steamship:
- File raw data can either be created directly or imported via a File Importer
- Blocks on Files can either be created directly or created from raw data by a Blockifier
- Once you have blocks, you can run Generators and Taggers
- Find data that you need by querying
- Index data for search with the embedding search index