SCNET · Enterprise IT · Ankara, Türkiye

Sanal Çekirdek

A data lake without governance is an expensive archive.

A data lake is not about copying everything into one place. Sanal Çekirdek builds it as layers: raw data stays as it arrived, the cleansed layer is trustworthy, and the serving layer is ready for use.

Data without a catalog and an owner eventually becomes a pile nobody trusts. Producing reports from that pile is riskier than producing none.

Layered structure

Raw, cleansed and serving layers stay separate. The raw layer is a copy of the source and is never modified; corrections happen in the cleansed layer so the origin of an error remains traceable.

  • The raw layer is append-only, never edited
  • Transformation rules are defined in code and versioned
  • The serving layer is shaped around business definitions
  • Movement between layers passes a quality gate

Catalog, ownership and quality

Every dataset needs an owner, a definition and a quality expectation. The catalog gives that information to whoever is searching, and quality rules turn the expectation into something measurable.

  • Owner and definition are recorded per dataset
  • Quality rules run as data arrives
  • A rule breach stops or flags the data
  • Lineage shows where each field came from

Access and privacy

A lake holds the broadest collection of data in the organization, so access design is part of the architecture. Fields containing personal data are marked, and masking and aggregation are applied through a rule set.

  • Personal data fields are marked through classification
  • Masking applies at query time rather than by copying
  • Access is role-based and logged
  • Analysis environments do not receive production data as-is

Cost and lifecycle

Storage is cheap; querying is not. Unless partitioning, file format and retention tiers are planned early, cost grows faster than data volume — and unused datasets live forever.

  • Partitioning follows the query pattern
  • Hot, warm and cold tiers are defined
  • Unused datasets are flagged and archived
  • Cost is reported back to the dataset owner

How we work

  1. Map the sources and the use cases
  2. Build the layered structure and transformation rules
  3. Put catalog and ownership into service
  4. Apply access and masking rules
  5. Report cost and usage back to owners

How success is measured

  • Every dataset has an owner and a definition
  • Quality breaches return to the source
  • Personal data fields are classified
  • The proportion of unused datasets is falling

Frequently asked questions

Does it replace a data warehouse?

It complements rather than replaces. A warehouse is efficient for structured, frequently queried data; a lake holds raw and varied data. In most organizations the two run together.

Should everything go into the lake?

No. Data with no use case brings nothing but cost and compliance burden. Source selection works backwards from the use case.

What stops it becoming a swamp?

Catalog, ownership and quality rules. Without those three the lake works technically but becomes a store nobody trusts.

Share your use cases and we will decide together which sources belong in the lake.

Share your use cases