EIQ_AI Model Creation and AI Prediction Models

An AI Model Training, Prediction, and Database Construction System Utilizing Machine Learning and SDCA Regression

VB.NET .NET Framework 4.8 Microsoft.ML Access (.accdb)

1. System Overview and Role of AI Prediction Models

This system is a Windows Forms application that constructs refined AI prediction models (AI models) from shipping data by combining EIQ analysis (Entry-Item-Quantity analysis) methods with advanced machine learning.

Taking the number of delivery destinations (E) and number of items (I) as inputs, it predicts approximately 160 items—including loose quantities, line counts, EIQ metrics, case counts, pallet counts, volume, and weight—using the SDCA regression (Microsoft.ML) machine learning algorithm.

Key Features

【Technical Explanation: From Static Analysis to Dynamic AI Prediction Models】

Traditional EIQ analysis was limited to static aggregations ("points") of historical data. In this system, by having machine learning AI models learn the fluctuations in destination counts (E) and item counts (I), EIQ analysis evolves into "AI prediction models" capable of dynamically simulating facility capacity and workload.
This system represents a next-generation simulation platform that algorithmizes 30 years of logistics consulting expertise. While conventional EIQ analysis merely aggregated past shipment results statically, this system acts as a "logistics digital twin" that dynamically forecasts capacity for new or consolidated facilities as the AI model learns fluctuations in delivery destinations (E) and item counts (I).

2. File Structure

FileClass / ModuleRole
E0_メニュー画面.vb E0_MenuScreenF Main menu. Navigation to processing screens and checking database status
E1_データ前処理.vb EIQ_AIModelPreprocessingF Import shipping data, classification conversion, create EIQ rankings, build T200 table
E2_モデルデータ設定.vb ModelDataSettingsF E/I ratio & pitch settings, manage T300_Progress table, navigate to E3 screen
E3_モデルデータ作成.vb E3_ModelDataCreationF Build T600_DataModel based on T300_Progress (batch processing)
E4_機械学習.vb E4_MachineLearningF Train AI models, execute predictions, and export using Microsoft.ML (SDCA regression)
EIQ_AI実証及び検証Pro.vb EIQ_AIVerificationAndValidationPro Verification and validation of AI prediction models (for future expansion)
K1.vb Module K1 Manage global variables, constants, and file paths
AccessDbManager.vb AccessDbManager Create new Access databases and import Excel data
Access操作.vb — SQL execution helpers and common database table processing
テーブル構造確認.vb — Database structure verification & diagnostic utility
【Practical Significance: Data Cleansing & Feature Engineering】

Because raw logistics field data often contains mixed units and errors, "automated classification conversion" standardizes shipping units (loose, case, etc.) to guarantee calculation accuracy. Additionally, automatically executing a "5-stage Pareto analysis (EIQ ranking)" enables the AI model to recognize which product groups drive center workloads as "features."
Built on VB.NET and Microsoft Access (database), this system is clearly modularized across processing phases. By adopting a design that completes entirely within the local environment (.accdb) without relying on external cloud services, it maintains strict confidentiality for sensitive shipping data while achieving high-speed batch processing in a desktop environment.

3. Overall Processing Flow for Building AI Prediction Models

E0 Menu Screen Check database status (presence of T200 table) → Select process
▼
Route A
Create from Shipping Data
Import Excel file
User-specified shipping data allowed
Route B
Attach to TeraCalculation.accdb
Link T200 from existing database
▼
E1 Data Preprocessing Create new Access DB → Import Excel → T110 Classification Conversion → Create T200 → Create GPL rankings
▼
E2 AI Model Data Settings Configure E/I ratios (50–150%) & pitch (1–20, default 5.9) → Create T300_Progress table
▼
E3 AI Model Data Creation Generate T600_DataModel for each record in T300_Progress (support pause/resume)
▼
E4 Machine Learning Execution Load DataModel.csv → Train models via SDCA regression (~160 models) → Execute predictions → Export CSV
▼
EIQ_AI Verification & Validation Verify trained AI prediction model accuracy & compare against actual data (future expansion)

Rather than relying on a single past pattern, thousands of "virtual shipping scenarios" varying E/I ratios between 50% and 150% are generated to train the AI model.

【Software Highlight: Learning Boundary Values】

By simulating numerical outcomes under extreme conditions—such as "What if delivery destinations increase by 1.5x?" or "What if items are halved?"—the AI prediction model gains an accurate understanding of the facility's "growth margin" and "processing limits."

4. Detailed Step Descriptions

E0 Menu Screen E0_MenuScreenF

Entry point when launching the application.

E1 Data Preprocessing EIQ_AIModelPreprocessingF

Handles everything from shipping data import to creating the T200 table for EIQ analysis (storing into the database).

Processing Sub-flow (Create from Shipping Data)

ShippingData.xlsx → Create New Access DB → T000_ShippingData → T100_Data
T100_Data → T110_ClassificationConversion → T150_RankSummary → T180_EIQRank
T180_EIQRank → T200 (Processed EIQ Data) → T160_GPLRank → T200 (Add Columns)
ProcessContentGenerated Tables
Create New Access DBCreate new EIQ_AIModel.accdb—
Import to AccessImport ShippingData.xlsx into databaseT000_ShippingData
T110 Classification ConversionCreate T100_Data, create conversion table, compute conversion calculations, shipping unit classificationsT100_Data, T110_ClassificationConversion
Create T200 (EIQ Data Processing)Summarize EI for case/loose shipments, T180 EIQ rankings, integrate into T200 tableT150_*, T180_EIQRank, T200
All-Shipment GPL RankingsCreate E/I rankings for all GPL shipments, add columns to T200T160_AllShipmentESummary, T160_AllShipmentISummary
📌 ABC Ranking Criteria: Performs 5-stage ranking (Ranks A1 / A2 / B / C / D) based on Pareto analysis of cumulative ratios. Rank settings can be customized in the Calculation Rule Settings tab.

E2 AI Model Data Settings ModelDataSettingsF

Configures generation parameters for AI prediction model training data using machine learning.

ParameterRangeDescription
E Min / Max Ratio50% to 150%Range of destination count fluctuations (ratio relative to baseline)
I Min / Max Ratio50% to 150%Range of item count fluctuations (ratio relative to baseline)
Record Pitch1 to 20 (Default: 5.9)Interval between generated records (smaller pitch = higher data density)

T300_Progress Table

E3 AI Model Data Creation E3_ModelDataCreationF

Sequentially processes uncompleted records in T300_Progress table and writes data into T600_DataModel in the database.

T600_DataModel Structure (165 Fields)

CategoryFieldsCount
Basic InfoModel Serial No., Destination Count, Item Count, Loose Quantity, Line Count5
E MetricsE1 to E55
I MetricsI1 to I55
Line Count by RankLineCount01 to LineCount2525
Loose Quantity by RankLooseQty01 to LooseQty2525
Case Count by RankCase01 to Case2525
Pallet Count by RankPL01 to PL2525
Volume by RankVolume01 to Volume2525
Weight by RankWeight01 to Weight2525
📌 Pause & Resume: Because processing is managed by the CreationChk flag in T300_Progress, even if interrupted, execution can resume from uncompleted records. Includes a keyboard interrupt feature via the GetAsyncKeyState API.

E4 Machine Learning Execution E4_MachineLearningF

Trains and predicts AI prediction models via SDCA regression using Microsoft.ML.

Machine Learning Pipeline

DataModel.csv → Feature Concatenation
(Destinations, Items)
→ MinMax Normalization → SDCA Regression → Save .zip Models
FunctionDescription
Data ImportLoads DataModel.csv via LoadFromTextFile and displays record counts
Execute Machine LearningTrains an SDCA regression model for each output field, saving as .zip files in Models/
Load Trained AI ModelsBatch loads saved .zip models (enables predictions without retraining)
Execute PredictionsInput destination count & item count → Predict via all AI models → Display results in DataGridView
Export ResultsExports prediction output as PredictionResults.csv in UTF-8 format

Inputs & Outputs

TypeItems
Inputs (Explanatory Variables)Destination Count, Item Count
Outputs (Target Variables)Loose Qty, Line Count, E1-E5, I1-I5, Lines 01-25, Loose Qty 01-25, Cases 01-25, PL 01-25, Volume 01-25, Weight 01-25
(Total: ~160 items × 1 AI Model each)
【Explanations of Step Details】

By simulating numerical outcomes under extreme conditions—such as "What if delivery destinations increase by 1.5x?" or "What if items are halved?"—the AI prediction model gains an accurate understanding of the facility's "growth margin" and "processing limits."

  • Data Preprocessing (E1): Corrects shipping unit variations through "classification conversion" and automatically executes EIQ ranking via Pareto analysis, building high-quality training data that helps machine learning capture volume characteristics.
  • Simulation (E2 & E3): Generates thousands of "virtual scenarios" varying E/I ratios between 50% and 150% beyond baseline shipping conditions. This teaches the AI model facility growth margins and processing limits accurately.
  • Machine Learning (E4): Adopts "SDCA regression (Stochastic Dual Coordinate Ascent)," balancing training efficiency with predictive accuracy. Trains 160 individual target variables separately and exports lightweight prediction engines in .zip format.

5. Database Structure

Database: TeraCalculationData\EIQAnalysisAI\EIQ_AIModel.accdb (Microsoft Access)

TableCreated ByPurpose
T000_ShippingDataE1 (Excel Import)Raw shipping data source
T100_DataE1Basic shipping data (with row serial numbers)
T110_ClassificationConversionE1Conversion data based on shipping classifications
T150_CBUnitShippingEISummaryE1EI summaries & ABC rankings for case/loose shipments
T160_AllShipmentEISummaryE1All-shipment GPL rankings (by E/I)
T180_EIQRankE1Integrated EIQ ranking table (CE/CI/BE/BI)
T200E1Processed EIQ analysis data (integrated ranks & metrics)
T300_ProgressE2Progress management for AI model data creation (Serials, Settings, CreationChk)
T600_DataModelE3Data model for machine learning (165 fields)
【Database Structure Explanation】

The proprietary database table progression (expanding from T200 to T600) embodies core logistics expertise. Raw historical data in T000 is transformed into structured EIQ metrics in T200, and ultimately elevated into a 165-field machine learning AI model (T600).

  • Data Preprocessing (E1): Corrects unit variations via classification conversion and runs automated EIQ ranking to prepare high-quality data.
  • Simulation (E2 & E3): Generates thousands of virtual scenarios across E/I ratios from 50% to 150%. Enables the AI model to learn facility boundaries.
  • Machine Learning (E4): Utilizes SDCA regression for fast, accurate model training across 160 parameters exported into zip models.

6. Execution Environment & Prerequisites

ItemRequirement
Framework.NET Framework 4.8
LanguageVB.NET (Windows Forms)
Primary LibrariesMicrosoft.ML (Machine Learning with SDCA regression), ClosedXML, ADOX, Microsoft.Office.Interop.Access
DatabaseMicrosoft Access (ACE OLEDB 12.0)
Data Storage PathTeraCalculationData folder on any drive (Auto-scans drives A: through F:)
Required FileTeraCalculationData\EIQAnalysisAI\ShippingData.xlsx (when creating from shipping data)
📌 Automatic File Path Detection: The FileCheck() method in K1.vb scans drives A: to F: and automatically detects the TeraCalculationData folder. An error is raised if the folder exists on multiple drives.
【Execution Environment & Prerequisites Explanation】

From the frontend UI to backend databases and machine learning AI prediction model integrations, the entire technology stack is unified under .NET Framework 4.8. This consistency minimizes library conflicts, ensures adaptability to OS updates, and delivers exceptional desktop responsiveness.

7. Data Model Transformation Flowchart

📄 ShippingData.xlsx
▼
T000_ShippingData → T100_Data → T110_ClassificationConversion
▼
T150_RankSummary → T180_EIQRank → T200 (Integrated)
▼
T160_GPL Rankings → T200 (Add Columns)
▼
T300_Progress (Settings) → T600_DataModel
▼
📄 DataModel.csv → 🤖 AI Prediction Model via SDCA Regression (.zip)
▼
📊 PredictionResults.csv
【Data Transformation Flowchart Explanation】

Raw Excel data evolves from "logistics data structuring" in T200 to "simulation space construction" in T600, culminating in an AI prediction model powered by machine learning. Through this sequence of database construction steps, unstructured shipment records become strategic assets supporting future facility engineering.