Importing

Choose your import method

When you create a dataset, you're also choosing how to import your data. Click the small orange "+" button in the dataset navigation menu and select from these import methods:

• Import existing: Upload existing data files or connect to live data sources.
  • -File upload: Import XML, CSV, Excel files, or Google Sheets directly from your device.
  • -URL import: Connect to live data sources by providing XML or CSV URLs for automatic synchronization.
  • -Best for: When you already have data that you want to bring into Cension for enrichment.
• From scratch: Generate entirely new datasets using AI based on your descriptions.
  • -AI generation: Describe what data you want (e.g., "Generate 100 fictional SaaS companies") and Cension creates it from scratch.
  • -Schema definition: The AI suggests appropriate columns, which you can customize before generation.
  • -Scale control: Choose how many rows to generate (from 10 to 100,000+).
  • -Best for: Creating test data, market research, or content generation scenarios.
• Create empty: Set up a dataset container for later data population.
  • -Empty container: Creates a dataset structure without any initial data.
  • -API-ready: Perfect for scenarios where you'll populate the dataset programmatically using the Cension API.
  • -Manual setup: Add columns and data later through various import methods.
  • -Best for: API integrations, scheduled imports, or when you want to define the schema before adding data.

Spreadsheet & tabular formats

• CSV (.csv): The standard for data exchange.
  • -Header detection: Automatically identifies the first row as column headers (supports skipping initial rows).
  • -Delimiters: Auto-detects common delimiters.
• Excel (.xlsx): Direct import from modern Excel workbooks.
  • -Data types: Preserves native data types (Dates, Numbers, Text).

Structured data formats

• JSON (.json): Supports both Array of Objects and Single Object formats.
  • -Flattening: Automatically extracts top-level keys as columns. If the root is an array, it iterates through items; if it's a single object, it treats it as a single row.
• XML (.xml): Parses complex XML hierarchies.
  • -Schema discovery: Scans the first 100 elements to discover all unique tags and attributes, creating a unified header capability for irregular data.

Live connection types

• URL import: Ingest data from any publicly accessible HTTP/HTTPS URL (CSV, JSON, XML).
• Google Drive: Select files directly from your connected Google Drive folders.
• Image feeds: Pass a list of image URLs. Cension downloads them server-side to bypass CORS.

Automation features

• Scheduled sync: Set up automatic data refreshes at specified intervals.
• Change detection: Only sync when source data has actually changed.
• Error handling: Built-in retry logic and failure notifications.

API capabilities

• Bulk uploads: Send large datasets programmatically with batch processing.
• Real-time sync: Push data updates as they occur in your systems.
• Webhook integration: Receive notifications when imports complete or fail.

Authentication

All API requests require authentication using your organization's API key. Include it in the Authorization header of all requests.

Rate limits

• Standard requests: 10 concurrent operations per user.
• Bulk operations: Up to 10,000 records per request.
• File size: Maximum 50MB per upload.