Job Documentation
Generated by Talend Open Studio


PROJECT NAME Proyecto Ventas BI GENERATION DATE 09-ene-2010 19:25:17
AUTHOR respinosa@terramiticapark.comT.O.S VERSION 4.0.0.M1_r33789

Summary

Project Description
Job Description
Job Preview Picture
Job Settings
Context List
Component List
Components Description


Project Description


Properties Values
NameProyecto Ventas BI
Languagejava
Description
Proyecto Ventas EnoBI


Job Description


Properties Values
NameDimProducto
Authorrespinosa@terramiticapark.com
Version0.1
PurposeETL Dimension Producto
StatusDEV
Description
Proceso para llenado de la dimensión Producto (tabla DWD_PRODUCTO) desde el sistema Sap
Creation27-may-2009 7:20:14
Modification 09-ene-2010 19:14:18

Job Preview Picture


No image available
tFileOutputExcel_1tFlowMeter_16tFlowMeter_21tFlowToIterate_1tLogCatcher_1tLogRow_1tMap_1tMap_2tMysqlInput_1tMysqlInput_2tMysqlOutput_1tOracleInput_1tOracleInput_3tOracleInput_4tOracleInput_5tOracleInput_6tOracleInput_7tOracleInput_9tPrejob_1tReplace_1tSendMail_1tSetGlobalVar_1tWarn_1tWarn_2

Job settings

Extra settings

Name Value
COMP_DEFAULT_FILE_DIRC:/TOS-Win32-r33789-V4.0.0M1/workspace
Multi thread executionfalse
Implicit tContextLoadfalse


Stats & Logs

Name Value
Use statistics (tStatCatcher)true
Use logs (tLogCatcher)true
Use volumetrics (tFlowMeterCatcher)true
On Consolefalse
On Filestrue
File Path"C:/temp/talend"
Log File Name"logs_file.txt"
Meter file name"meter_file.txt"
Stats File Name"stats_file.txt"
On Databasestrue
Property Type
PropiedadREPOSITORY
Property:sourcestage_area
Db TypetMysqlOutput
Hostcontext.stage_area_Server
Portcontext.stage_area_Port
Db Name context.stage_area_Database
Additional parameterscontext.stage_area_AdditionalParams
Schema""
Usuariocontext.stage_area_Login
Password ******
Base de Datos""
Logs Table"Logs"
Meter Table"Meter"
Stats Table"Stats"
Catch components statisticstrue
Catch runtime errorstrue
Catch user errorstrue
Catch user warningstrue


Context List

Context : Default

Name Prompt Need Prompt? Type Value Source
tm_int_Sidtm_int_Sid?falseid_StringMG1tm_int
tm_int_Logintm_int_Login?falseid_Stringsystemtm_int
tm_int_Porttm_int_Port?falseid_String1527tm_int
tm_int_Schematm_int_Schema?falseid_StringSAPR3tm_int
tm_int_Passwordtm_int_Password?falseid_Password******tm_int
tm_int_Servertm_int_Server?falseid_Stringtm_inttm_int
stage_area_AdditionalParamsstage_area_AdditionalParams?falseid_StringnoDatetimeStringSync=truestage_area
stage_area_Passwordstage_area_Password?falseid_Password******stage_area
stage_area_Portstage_area_Port?falseid_String3306stage_area
stage_area_Databasestage_area_Database?falseid_Stringstage_areastage_area
stage_area_Serverstage_area_Server?falseid_Stringlocalhoststage_area
stage_area_Loginstage_area_Login?falseid_Stringrootstage_area
enobi_AdditionalParamsenobi_AdditionalParams?falseid_StringnoDatetimeStringSync=trueenobi
enobi_Serverenobi_Server?falseid_Stringlocalhostenobi
enobi_Loginenobi_Login?falseid_Stringrootenobi
enobi_Portenobi_Port?falseid_String3306enobi
enobi_Databaseenobi_Database?falseid_Stringenobienobi
enobi_Passwordenobi_Password?falseid_Password******enobi




Component List

Component Name Component Type
tFileOutputExcel_1tFileOutputExcel
tFlowMeter_16tFlowMeter
tFlowMeter_21tFlowMeter
tFlowToIterate_1tFlowToIterate
tLogCatcher_1tLogCatcher
tLogRow_1tLogRow
tMap_1tMap
tMap_2tMap
tMysqlInput_1tMysqlInput
tMysqlInput_2tMysqlInput
tMysqlOutput_1tMysqlOutput
tOracleInput_1tOracleInput
tOracleInput_3tOracleInput
tOracleInput_4tOracleInput
tOracleInput_5tOracleInput
tOracleInput_6tOracleInput
tOracleInput_7tOracleInput
tOracleInput_9tOracleInput
tPrejob_1tPrejob
tReplace_1tReplace
tSendMail_1tSendMail
tSetGlobalVar_1tSetGlobalVar
tWarn_1tWarn
tWarn_2tWarn

Components Description

Component:   tFileOutputExcel

      UNIQUE NAME tFileOutputExcel_1 INPUT(S) tMap_1,  tOracleInput_3,  tOracleInput_5,  tOracleInput_4,  tOracleInput_6,  tOracleInput_7,  tOracleInput_9
LABEL REGISTROS_ERRONEOS OUTPUT(S) none

Component Parameters:
Properties Values
Activatetrue
tStatCatcher Statisticsfalse
Use Output Streamfalse
File Name"C:/temp/talend/rechazados.xls"
Sheet name"Sheet1"
Include headerfalse
Añadir al fichero existentetrue
Añadir a la hoja existentetrue
Is absolute Y pos.false
Font
Define all columns auto sizefalse
Define column auto size[{IS_AUTO_SIZE=false, SCHEMA_COLUMN=material_id}, {IS_AUTO_SIZE=false, SCHEMA_COLUMN=material_desc}, {IS_AUTO_SIZE=false, SCHEMA_COLUMN=familia_id}, {IS_AUTO_SIZE=false, SCHEMA_COLUMN=familia_desc}, {IS_AUTO_SIZE=false, SCHEMA_COLUMN=denom_id}, {IS_AUTO_SIZE=false, SCHEMA_COLUMN=variet_id}, {IS_AUTO_SIZE=false, SCHEMA_COLUMN=formato_id}, {IS_AUTO_SIZE=false, SCHEMA_COLUMN=um_id}, {IS_AUTO_SIZE=false, SCHEMA_COLUMN=litros_id}, {IS_AUTO_SIZE=false, SCHEMA_COLUMN=linprod_id}, {IS_AUTO_SIZE=false, SCHEMA_COLUMN=linprod_desc}, {IS_AUTO_SIZE=false, SCHEMA_COLUMN=target_id}]
Create directory if not existstrue
Advanced separator(for number)false
Codificación"ISO-8859-15"
Show Informationfalse
ComentarioEn el mapeo se verifica que la conversión a litros no devuelva un valor NULL, en cuyo caso el registro se rechaza y es enviado a un fichero Excel para su revisión.

Schema for tFileOutputExcel_1 :
Column Key Type Length Precision Nullable Comment
material_idtruelong7false
material_descfalseString40false
familia_idfalseshort6false
familia_descfalseString20false
denom_idfalseString30false
variet_idfalseString45false
formato_idfalseString18false
um_idfalseString10false
litros_idfalseFloat102true
linprod_idfalseshort6false
linprod_descfalseString20false
target_idfalseString50false

Original Function Parameters:
Component:   tFlowMeter

      UNIQUE NAME tFlowMeter_16 INPUT(S) tMap_1
LABEL CUENTA_LEIDOS_SAP OUTPUT(S) tLogRow_1

Component Parameters:
Properties Values
Activatetrue
tStatCatcher Statisticsfalse
Use input connection name as labeltrue
ModeRelative
Connections ListRechazados
Thresholds[]
Show Informationfalse
ComentarioIncluimos en el flujo un control tFlowMeter para contar el numero de registros recuperados desde Sap (el valor se guarda en la tabla METER).

Schema for tFlowMeter_16 :
Column Key Type Length Precision Nullable Comment
material_idtruelong7false
material_descfalseString40false
familia_idfalseshort6false
familia_descfalseString20false
denom_idfalseString30false
variet_idfalseString45false
formato_idfalseString18false
um_idfalseString10false
litros_idfalseFloat102true
linprod_idfalseshort6false
linprod_descfalseString20false
target_idfalseString50false

Original Function Parameters:
Component:   tFlowMeter

      UNIQUE NAME tFlowMeter_21 INPUT(S) tMap_2,  tMysqlInput_2
LABEL CUENTA_MODIFICADOS OUTPUT(S) tMysqlOutput_1

Component Parameters:
Properties Values
Activatetrue
tStatCatcher Statisticsfalse
Use input connection name as labeltrue
Mode/ouative
Connections ListRechazados
Thresholds[]
Show Informationfalse
ComentarioIncluimos en el flujo un control tFlowMeter para contar el numero de registros recuperados desde Sap que incluyen alta o modificacion y que generaran un proceso de insert o update en la base de datos del DWH (el valor se guarda en la tabla METER).

Schema for tFlowMeter_21 :
Column Key Type Length Precision Nullable Comment
material_idtruelong7false
material_descfalseString40false
familia_idfalseshort6false
familia_descfalseString20false
denom_idfalseString30false
variet_idfalseString45false
formato_idfalseString18false
um_idfalseString10false
litros_idfalsefloat102false
linprod_idfalseshort6false
linprod_descfalseString20false
target_idfalseString50false

Original Function Parameters:
Component:   tFlowToIterate

      UNIQUE NAME tFlowToIterate_1 INPUT(S) tLogCatcher_1
LABEL __UNIQUE_NAME__ OUTPUT(S) tSendMail_1

Component Parameters:
Properties Values
Activatetrue
tStatCatcher Statisticsfalse
Use the default (key, value) in global variables.true
Show Informationfalse
Comentario

Schema for tFlowToIterate_1 :
Column Key Type Length Precision Nullable Comment

Original Function Parameters:
Component:   tLogCatcher

      UNIQUE NAME tLogCatcher_1 INPUT(S) tSetGlobalVar_1
LABEL CONTROL_ERRORES OUTPUT(S) tFlowToIterate_1

Component Parameters:
Properties Values
Activatetrue
tStatCatcher Statisticsfalse
Catch Java Exceptiontrue
Catch tDietrue
Catch tWarnfalse
Show Informationfalse
ComentarioDisparo el componente tLogCatcher, solo para los mensajes de error (die) y para las excepciones Java. Este componente se quedara escuchando durante la ejecución de todos los pasos del job, y en el caso de que haya error, se activara y producira el envio de un email de notificación.

Schema for tLogCatcher_1 :
Column Key Type Length Precision Nullable Comment
momentfalsejava.util.Datetrue
pidfalseString20true
root_pidfalseString20true
father_pidfalseString20true
projectfalseString50true
jobfalseString255true
contextfalseString50true
priorityfalseInteger3true
typefalseString255true
originfalseString255true
messagefalseString255true
codefalseInteger3true

Original Function Parameters:
Component:   tLogRow

      UNIQUE NAME tLogRow_1 INPUT(S) tFlowMeter_16
LABEL __UNIQUE_NAME__ OUTPUT(S) tMap_2

Component Parameters:
Properties Values
Activatetrue
tStatCatcher Statisticsfalse
Basictrue
Table (print values in cells of a table)false
Vertical (each row is a key/value list)false
Field Separator"|"
Print headerfalse
Print component unique name in front of each output rowfalse
Print schema column name in front of each valuefalse
Use fixed length for valuesfalse
Show Informationfalse
ComentarioLog de visualización del flujo de datos para debug y verificaciones.

Schema for tLogRow_1 :
Column Key Type Length Precision Nullable Comment
material_idtruelong7false
material_descfalseString40false
familia_idfalseshort6false
familia_descfalseString20false
denom_idfalseString30false
variet_idfalseString45false
formato_idfalseString18false
um_idfalseString10false
litros_idfalsefloat102false
linprod_idfalseshort6false
linprod_descfalseString20false
target_idfalseString50false

Original Function Parameters:
Component:   tMysqlInput

      UNIQUE NAME tMysqlInput_1 INPUT(S) tPrejob_1
LABEL ULTIMA_FECHA_EJECUCION OUTPUT(S) tSetGlobalVar_1,  tWarn_1

Component Parameters:
Properties Values
Activatetrue
tStatCatcher Statisticstrue
Use an existing connectiontrue
Component ListconnectionStatsLogs
Table Name"logs"
Guess Schema""
Query"select ifnull(max(logs.moment),MAKEDATE(2009,1)) as ultima_ejec from logs where logs.project = '" + ((String)projectName) + "' and logs.job = '" + ((String)jobName) + "' and message = 'FIN' and code = 0"
Codificación"ISO-8859-15"
Enable streamfalse
Trim all the String/Char columnsfalse
Trim column[{SCHEMA_COLUMN=ultima_ejec, TRIM=false}]
Show Informationfalse
ComentarioRecuperamos de la tabla logs, la ultima fecha de ejecución CORRECTA del job. Esta fecha sera el punto de partida para recuperar los materiales dados de alta o modificaciones desde dicho momento. En el caso de que no se haya ejecutado nunca el proceso, generamos una fecha de referencia para la primera carga de datos (CARGA INICIAL).

Schema for tMysqlInput_1 :
Column Key Type Length Precision Nullable Comment
ultima_ejecfalsejava.util.Datetrue

Original Function Parameters:
Component:   tMysqlInput

      UNIQUE NAME tMysqlInput_2 INPUT(S) none
LABEL LEER_DWD_PRODUCTO OUTPUT(S) tMap_2

Component Parameters:
Properties Values
Activatetrue
tStatCatcher Statisticsfalse
Use an existing connectionfalse
Hostcontext.enobi_Server
Portcontext.enobi_Port
Base de Datoscontext.enobi_Database
Usernamecontext.enobi_Login
Passwordcontext.enobi_Password
Table Name"dwd_producto"
Guess Schema""
Query"SELECT dwd_producto.material_id, dwd_producto.material_desc, dwd_producto.familia_id, dwd_producto.familia_desc, dwd_producto.denom_id, dwd_producto.variet_id, dwd_producto.formato_id, dwd_producto.um_id, dwd_producto.litros_id, dwd_producto.linprod_id, dwd_producto.linprod_desc, dwd_producto.target_id FROM dwd_producto"
Additional JDBC Parameterscontext.enobi_AdditionalParams
Codificación"ISO-8859-15"
Enable streamfalse
Trim all the String/Char columnsfalse
Trim column[{SCHEMA_COLUMN=material_id, TRIM=false}, {SCHEMA_COLUMN=material_desc, TRIM=false}, {SCHEMA_COLUMN=familia_id, TRIM=false}, {SCHEMA_COLUMN=familia_desc, TRIM=false}, {SCHEMA_COLUMN=denom_id, TRIM=false}, {SCHEMA_COLUMN=variet_id, TRIM=false}, {SCHEMA_COLUMN=formato_id, TRIM=false}, {SCHEMA_COLUMN=um_id, TRIM=false}, {SCHEMA_COLUMN=litros_id, TRIM=false}, {SCHEMA_COLUMN=linprod_id, TRIM=false}, {SCHEMA_COLUMN=linprod_desc, TRIM=false}, {SCHEMA_COLUMN=target_id, TRIM=false}]
Show Informationfalse
ComentarioRecuperamos los registros existentes en la tabla DWD_PRODUCTO para comprobar si hay cambios con los registros recuperados desde el ERP y en caso afirmativo, pasar los registros al proceso de actualización.

Schema for row12 :
Column Key Type Length Precision Nullable Comment
material_idtruelong10falseCodigo Material (PK): clave
material_descfalseString40falseDescripcion Material
familia_idfalseshort5falseIdentificador Familia
familia_descfalseString20falseDescripcion Familia
denom_idfalseString30falseDesc. denominacion origen
variet_idfalseString45falseDescripcion varietales
formato_idfalseString18falseDesc. formato venta
um_idfalseString10falseIdentificador de la unidad de medida de venta
litros_idfalsefloat102falseEquivalencia en litros
linprod_idfalseshort5falseIdentificador de la linea de producto
linprod_descfalseString20falseDescripcion de la linea de producto
target_idfalseString50falseDescripcion de Target del producto

Original Function Parameters:
Component:   tMysqlOutput

      UNIQUE NAME tMysqlOutput_1 INPUT(S) tFlowMeter_21
LABEL __UNIQUE_NAME__ OUTPUT(S) tWarn_2

Component Parameters:
Properties Values
Activatetrue
tStatCatcher Statisticsfalse
Use an existing connectionfalse
Hostcontext.enobi_Server
Portcontext.enobi_Port
Base de Datoscontext.enobi_Database
Usernamecontext.enobi_Login
Passwordcontext.enobi_Password
Table"dwd_producto"
Action on tableNONE
Action on dataINSERT_OR_UPDATE
Schema
Die on errorfalse
Additional JDBC Parameterscontext.enobi_AdditionalParams
Codificación"ISO-8859-15"
Commit every10000
Columnas adicionales[]
Use field optionsfalse
Use Hint Optionsfalse
Enable debug modefalse
Show Informationfalse
ComentarioInserción en Mysql, en la tabla del DWH correspondiente a la dimensión Producto (DWD_PRODUCTO).

Schema for tMysqlOutput_1 :
Column Key Type Length Precision Nullable Comment
material_idtruelong7false
material_descfalseString40false
familia_idfalseshort6false
familia_descfalseString20false
denom_idfalseString30false
variet_idfalseString45false
formato_idfalseString18false
um_idfalseString10false
litros_idfalsefloat102false
linprod_idfalseshort6false
linprod_descfalseString20false
target_idfalseString50false

Original Function Parameters:
Component:   tOracleInput

      UNIQUE NAME tOracleInput_1 INPUT(S) none
LABEL LECT_MAESTRO_PRODUCTO OUTPUT(S) tReplace_1

Component Parameters:
Properties Values
Activatetrue
tStatCatcher Statisticstrue
Use an existing connectionfalse
Connection TypeORACLE_SID
DB Versionojdbc14-9i.jar
Hostcontext.tm_int_Server
Portcontext.tm_int_Port
Base de Datoscontext.tm_int_Sid
Oracle schemacontext.tm_int_Schema
Usernamecontext.tm_int_Login
Passwordcontext.tm_int_Password
Table Name"MARA"
Guess Schema""
Query"SELECT MARA.matnr, MARA.matkl, MARA.LABOR, MARA.FERTH, MARA.NORMT, MARA.meins, MARA.extwg, MARA.WRKST FROM SAPR3.MARA where mtart = 'TICV' and laeda between '" + TalendDate.formatDate("yyyyMMdd",((Date)globalMap.get("ultima_ejec"))) + "' and '" + TalendDate.formatDate("yyyyMMdd",TalendDate.getCurrentDate()) + "' or ERSDA between '" + TalendDate.formatDate("yyyyMMdd",((Date)globalMap.get("ultima_ejec"))) + "' and '" + TalendDate.formatDate("yyyyMMdd",TalendDate.getCurrentDate()) + "'";
Codificación"ISO-8859-15"
Use cursorfalse
Trim all the String/Char columnsfalse
Trim column[{SCHEMA_COLUMN=matnr, TRIM=false}, {SCHEMA_COLUMN=matkl, TRIM=false}, {SCHEMA_COLUMN=labor, TRIM=false}, {SCHEMA_COLUMN=ferth, TRIM=false}, {SCHEMA_COLUMN=normt, TRIM=false}, {SCHEMA_COLUMN=meins, TRIM=false}, {SCHEMA_COLUMN=extwg, TRIM=false}, {SCHEMA_COLUMN=wrkst, TRIM=false}]
Show Informationfalse
ComentarioLectura Oracle desde Sap de la tabla MARA, que es el maestro de materiales. Se buscan los registros creados o modificados desde la fecha de la ultima ejecución hasta el momento actual.

Schema for tOracleInput_1 :
Column Key Type Length Precision Nullable Comment
matnrtrueStringfalseMaterial
matklfalseStringtrueFamilia
laborfalseStringtrueDenominacion Origen
ferthfalseStringtrueVarietal
normtfalseStringtrueFormato Venta
meinsfalseString3trueUnidad Medida
extwgfalseStringtrueLinea Producto
wrkstfalseStringtrueTarget

Original Function Parameters:
Component:   tOracleInput

      UNIQUE NAME tOracleInput_3 INPUT(S) none
LABEL LECT_DESC_PRODUCTO OUTPUT(S) tMap_1

Component Parameters:
Properties Values
Activatetrue
tStatCatcher Statisticsfalse
Use an existing connectionfalse
Connection TypeORACLE_SID
DB Versionojdbc14-9i.jar
Hostcontext.tm_int_Server
Portcontext.tm_int_Port
Base de Datoscontext.tm_int_Sid
Oracle schemacontext.tm_int_Schema
Usernamecontext.tm_int_Login
Passwordcontext.tm_int_Password
Table Name"MAKT"
Guess Schema""
Query"select matnr,maktx from sapr3.makt where spras = 'S' and matnr = " + ((String)globalMap.get("var.matnr"))
Codificación"ISO-8859-15"
Use cursorfalse
Trim all the String/Char columnsfalse
Trim column[{SCHEMA_COLUMN=matnr, TRIM=false}, {SCHEMA_COLUMN=maktx, TRIM=false}]
Show Informationfalse
Comentario

Schema for tOracleInput_3 :
Column Key Type Length Precision Nullable Comment
matnrtrueStringfalse
maktxfalseStringfalse

Original Function Parameters:
Component:   tOracleInput

      UNIQUE NAME tOracleInput_4 INPUT(S) none
LABEL LECT_DESC_LINPROD OUTPUT(S) tMap_1

Component Parameters:
Properties Values
Activatetrue
tStatCatcher Statisticsfalse
Use an existing connectionfalse
Connection TypeORACLE_SID
DB Versionojdbc14-9i.jar
Hostcontext.tm_int_Server
Portcontext.tm_int_Port
Base de Datoscontext.tm_int_Sid
Oracle schemacontext.tm_int_Schema
Usernamecontext.tm_int_Login
Passwordcontext.tm_int_Password
Table Name"TWEWT"
Guess Schema""
Query"select EXTWG, EWBEZ from SAPR3.TWEWT where spras ='S' UNION select 'MERC9999','VINOS MESA' from sapr3.twewt where spras = 'S'"
Codificación"ISO-8859-15"
Use cursorfalse
Trim all the String/Char columnsfalse
Trim column[{SCHEMA_COLUMN=extwg, TRIM=false}, {SCHEMA_COLUMN=ewbez, TRIM=false}]
Show Informationfalse
Comentario

Schema for tOracleInput_4 :
Column Key Type Length Precision Nullable Comment
extwgtrueStringtrue
ewbezfalseStringtrue

Original Function Parameters:
Component:   tOracleInput

      UNIQUE NAME tOracleInput_5 INPUT(S) none
LABEL LECT_DESC_FAMILIA OUTPUT(S) tMap_1

Component Parameters:
Properties Values
Activatetrue
tStatCatcher Statisticsfalse
Use an existing connectionfalse
Connection TypeORACLE_SID
DB Versionojdbc14-9i.jar
Hostcontext.tm_int_Server
Portcontext.tm_int_Port
Base de Datoscontext.tm_int_Sid
Oracle schemacontext.tm_int_Schema
Usernamecontext.tm_int_Login
Passwordcontext.tm_int_Password
Table Name"T023T"
Guess Schema""
Query"select MATKL,WGBEZ from sapr3.T023T where spras = 'S'"
Codificación"ISO-8859-15"
Use cursorfalse
Trim all the String/Char columnsfalse
Trim column[{SCHEMA_COLUMN=matkl, TRIM=false}, {SCHEMA_COLUMN=wgbez, TRIM=false}]
Show Informationfalse
Comentario

Schema for tOracleInput_5 :
Column Key Type Length Precision Nullable Comment
matkltrueStringtrue
wgbezfalseStringtrue

Original Function Parameters:
Component:   tOracleInput

      UNIQUE NAME tOracleInput_6 INPUT(S) none
LABEL LECT_DESC_DENOM_ORIGEN OUTPUT(S) tMap_1

Component Parameters:
Properties Values
Activatetrue
tStatCatcher Statisticsfalse
Use an existing connectionfalse
Connection TypeORACLE_SID
DB Versionojdbc14-9i.jar
Hostcontext.tm_int_Server
Portcontext.tm_int_Port
Base de Datoscontext.tm_int_Sid
Oracle schemacontext.tm_int_Schema
Usernamecontext.tm_int_Login
Passwordcontext.tm_int_Password
Table Name"T024X"
Guess Schema""
Query"select LABOR, LBTXT from SAPR3.T024X where spras ='S' UNION select '9999','SIN DENOMINACION ORIGEN' from sapr3.T024X where spras = 'S'"
Codificación"ISO-8859-15"
Use cursorfalse
Trim all the String/Char columnsfalse
Trim column[{SCHEMA_COLUMN=labor, TRIM=false}, {SCHEMA_COLUMN=lbtxt, TRIM=false}]
Show Informationfalse
Comentario

Schema for tOracleInput_6 :
Column Key Type Length Precision Nullable Comment
labortrueStringtrue
lbtxtfalseStringtrue

Original Function Parameters:
Component:   tOracleInput

      UNIQUE NAME tOracleInput_7 INPUT(S) none
LABEL LECT_CONVERSION_LITROS OUTPUT(S) tMap_1

Component Parameters:
Properties Values
Activatetrue
tStatCatcher Statisticsfalse
Use an existing connectionfalse
Connection TypeORACLE_SID
DB Versionojdbc14-9i.jar
Hostcontext.tm_int_Server
Portcontext.tm_int_Port
Base de Datoscontext.tm_int_Sid
Oracle schemacontext.tm_int_Schema
Usernamecontext.tm_int_Login
Passwordcontext.tm_int_Password
Table Name"MARM"
Guess Schema""
Query"select matnr,umren from sapr3.marm where meinh = 'ML'"
Codificación"ISO-8859-15"
Use cursorfalse
Trim all the String/Char columnsfalse
Trim column[{SCHEMA_COLUMN=matnr, TRIM=false}, {SCHEMA_COLUMN=umren, TRIM=false}]
Show Informationfalse
Comentario

Schema for tOracleInput_7 :
Column Key Type Length Precision Nullable Comment
matnrtrueStringtrue
umrenfalseFloat102true

Original Function Parameters:
Component:   tOracleInput

      UNIQUE NAME tOracleInput_9 INPUT(S) none
LABEL LECT_UMEDIDA_ESP OUTPUT(S) tMap_1

Component Parameters:
Properties Values
Activatetrue
tStatCatcher Statisticsfalse
Use an existing connectionfalse
Connection TypeORACLE_SID
DB Versionojdbc14-9i.jar
Hostcontext.tm_int_Server
Portcontext.tm_int_Port
Base de Datoscontext.tm_int_Sid
Oracle schemacontext.tm_int_Schema
Usernamecontext.tm_int_Login
Passwordcontext.tm_int_Password
Table Name"T006A"
Guess Schema""
Query"select MSEHI,MSEH3 from sapr3.T006A where spras = 'S'"
Codificación"ISO-8859-15"
Use cursorfalse
Trim all the String/Char columnsfalse
Trim column[{SCHEMA_COLUMN=msehi, TRIM=false}, {SCHEMA_COLUMN=mseh3, TRIM=false}]
Show Informationfalse
Comentario

Schema for tOracleInput_9 :
Column Key Type Length Precision Nullable Comment
msehitrueString3false
mseh3falseString3false

Original Function Parameters:
Component:   tPrejob

      UNIQUE NAME tPrejob_1 INPUT(S) none
LABEL __UNIQUE_NAME__ OUTPUT(S) tMysqlInput_1

Component Parameters:
Properties Values
Activatetrue
tStatCatcher Statisticsfalse
Show Informationfalse
ComentarioPrejob para la orquestación del proceso. Tiene los siguientes pasos: -Recuperación de la ultima fecha de ejecución correcta del proceso. -Generación de mensaje de log de inicio del proceso. -Lanzamiento del componente tLogCatcher que quedara escuchando los mensajes de log generados, y en el caso de que se genere un error, mandara un email de notificación.


Original Function Parameters:
Component:   tReplace

      UNIQUE NAME tReplace_1 INPUT(S) tOracleInput_1
LABEL AJUSTE_CAMPOS OUTPUT(S) tMap_1

Component Parameters:
Properties Values
Activatetrue
tStatCatcher Statisticsfalse
Simple mode ( search with regexp pattern or glob expression)true
Search/Replace[{USE_GLOB=false, CASE_SENSITIVE=false, INPUT_COLUMN=extwg, REPLACE_STRING="MERC9999", COMMENT=Ajuste Linea Producto, WHOLE_WORD=true, SEARCH_PATTERN=" "}, {USE_GLOB=false, CASE_SENSITIVE=false, INPUT_COLUMN=labor, REPLACE_STRING="9999", COMMENT=Ajuste Denominac. Origen, WHOLE_WORD=true, SEARCH_PATTERN=" "}, {USE_GLOB=false, CASE_SENSITIVE=false, INPUT_COLUMN=wrkst, REPLACE_STRING="GRAN CONSUMO", COMMENT=Ajuste Target, WHOLE_WORD=true, SEARCH_PATTERN=" "}, {USE_GLOB=false, CASE_SENSITIVE=false, INPUT_COLUMN=ferth, REPLACE_STRING="MEZCLA", COMMENT=Ajuste Varietal, WHOLE_WORD=true, SEARCH_PATTERN=" "}, {USE_GLOB=false, CASE_SENSITIVE=false, INPUT_COLUMN=normt, REPLACE_STRING="BOTELLA", COMMENT=Ajuste Formato Venta, WHOLE_WORD=true, SEARCH_PATTERN=" "}]
Advanced mode ( search with regexp pattern )false
Show Informationfalse
ComentarioReemplazamos algunos campos en el caso de que venga vacios con valores genericos que agrupan los registros sin valor.

Schema for tReplace_1 :
Column Key Type Length Precision Nullable Comment
matnrtrueStringfalse
matklfalseStringtrue
laborfalseStringtrue
ferthfalseStringtrue
normtfalseStringtrue
meinsfalseString3true
extwgfalseStringtrue
wrkstfalseStringtrue

Original Function Parameters:
Component:   tSendMail

      UNIQUE NAME tSendMail_1 INPUT(S) tFlowToIterate_1
LABEL ENVIO_EMAIL_NOTIF OUTPUT(S) none

Component Parameters:
Properties Values
Activatetrue
tStatCatcher Statisticsfalse
To"respinosamilla@yahoo.com"
From"respinosamilla@gmail.com"
Show sender's name?false
Cc"respinosamilla@gmail.com"
Bcc
Subject"Error en ejecución del Job " + jobName
Message"Cancelado el trabajo " + jobName + "\nen el paso " + row12.origin + "\n con el mensaje de error " + row12.message
Die if the attachment file doesn't exist.true
Attachments[]
Other headers[]
SMTP host"smtp.gmail.com"
SMTP port465
SSL Supporttrue
STARTTLS Supportfalse
ImportanceHigh
Need authentication?true
Username"respinosamilla@gmail.com"
Password"atitelavoyadeciryo"
Die on errortrue
MIME subtype from the 'text' MIME typeplain
charset used for encoding message"ISO-8859-15"
Show Informationfalse
ComentarioEn el caso de error o excepción Java, enviamos un email informativo, indicado que el job se ha parado, en que paso y con que mensaje de error.

Schema for tSendMail_1 :
Column Key Type Length Precision Nullable Comment
momentfalsejava.util.Datetrue
pidfalseString20true
root_pidfalseString20true
father_pidfalseString20true
projectfalseString50true
jobfalseString255true
contextfalseString50true
priorityfalseInteger3true
typefalseString255true
originfalseString255true
messagefalseString255true
codefalseInteger3true

Original Function Parameters:
Component:   tSetGlobalVar

      UNIQUE NAME tSetGlobalVar_1 INPUT(S) tMysqlInput_1
LABEL SET_VARIABLE_FECHA OUTPUT(S) tLogCatcher_1

Component Parameters:
Properties Values
Activatetrue
tStatCatcher Statisticsfalse
Variables[{VALUE=row4.ultima_ejec, KEY="ultima_ejec"}]
Show Informationfalse
ComentarioLa fecha recuperada la almaceno en la variable global ultima_ejec para luego poder utilizarla en los diferentes pasos del job.

Schema for tSetGlobalVar_1 :
Column Key Type Length Precision Nullable Comment
ultima_ejecfalsejava.util.Datetrue

Original Function Parameters:
Component:   tWarn

      UNIQUE NAME tWarn_1 INPUT(S) tMysqlInput_1
LABEL MENSAJE_LOG_INICIO OUTPUT(S) none

Component Parameters:
Properties Values
Activatetrue
tStatCatcher Statisticsfalse
Warn message"INICIO"
Codigo0
Priority3
Show Informationfalse
ComentarioUtilizando el componente tWarn, genero un mensaje en el log correspondiente al INICIO del trabajo (generara un registro en la tabla LOGS).

Schema for tWarn_1 :
Column Key Type Length Precision Nullable Comment

Original Function Parameters:
Component:   tWarn

      UNIQUE NAME tWarn_2 INPUT(S) tMysqlOutput_1
LABEL MENSAJE_LOG_FIN OUTPUT(S) none

Component Parameters:
Properties Values
Activatetrue
tStatCatcher Statisticsfalse
Warn message"FIN"
Codigo0
Priority3
Show Informationfalse
ComentarioUtilizando el componente tWarn, genero un mensaje en el log correspondiente al FIN correcto del trabajo (generara un registro en la tabla LOGS).

Schema for tWarn_2 :
Column Key Type Length Precision Nullable Comment

Original Function Parameters:
Component:   tMap

      UNIQUE NAME tMap_1 INPUT(S) tMap_1,  tOracleInput_3,  tOracleInput_5,  tOracleInput_4,  tOracleInput_6,  tOracleInput_7,  tOracleInput_9
LABEL MAPEO_PRODUCTO OUTPUT(S) tFlowMeter_16,  tFileOutputExcel_1

No image available



Component Parameters:
Properties Values
tStatCatcher Statistics
true
Mapping links display as:
AUTO
Temp data directory path:
Max buffer size (nb of rows):
2000000
Show Information
false
Comentario
A partir del registro recuperado de la tabla MARA, realizamos un mapeo completando el resto de campos de la dimension con tablas de LOOKUP.

Recuperamos la descripción del producto, descripción de la familia, descripción de la linea de producto, descripción de la denominación de origen y la conversión a litros según las unidades de medida.

En el mapeo se verifica que la conversión a litros no devuelva  un valor NULL, en cuyo caso el registro se rechaza y es enviado a un fichero Excel para su revisión.

Mapper table for tMap_1 ( input ):
Mapper table Properties( row2 ):
Properties Values
Name row2
Matching-mode UNIQUE_MATCH
isMinimized false
isReject false
isRejectInnerJoin false
isInnerJoin false

Metadata Table Entries( row2 ):
Name Type Expression isNullable
matnrStringfalse
matklStringtrue
laborStringtrue
ferthStringtrue
normtStringtrue
meinsStringtrue
extwgStringtrue
wrkstStringtrue

Constraint Table Entries( row2 ):
Name Type Expression isNullable

Mapper table Properties( row6 ):
Properties Values
Name row6
Matching-mode UNIQUE_MATCH
isMinimized false
isReject false
isRejectInnerJoin false
isInnerJoin false

Metadata Table Entries( row6 ):
Name Type Expression isNullable
matnrStringrow2.matnr false
maktxStringfalse

Constraint Table Entries( row6 ):
Name Type Expression isNullable

Mapper table Properties( row5 ):
Properties Values
Name row5
Matching-mode UNIQUE_MATCH
isMinimized true
isReject false
isRejectInnerJoin false
isInnerJoin false

Metadata Table Entries( row5 ):
Name Type Expression isNullable
matklStringrow2.matkl true
wgbezStringtrue

Constraint Table Entries( row5 ):
Name Type Expression isNullable

Mapper table Properties( row7 ):
Properties Values
Name row7
Matching-mode UNIQUE_MATCH
isMinimized true
isReject false
isRejectInnerJoin false
isInnerJoin false

Metadata Table Entries( row7 ):
Name Type Expression isNullable
extwgStringrow2.extwg true
ewbezStringtrue

Constraint Table Entries( row7 ):
Name Type Expression isNullable

Mapper table Properties( row8 ):
Properties Values
Name row8
Matching-mode UNIQUE_MATCH
isMinimized true
isReject false
isRejectInnerJoin false
isInnerJoin false

Metadata Table Entries( row8 ):
Name Type Expression isNullable
laborStringrow2.labor true
lbtxtStringtrue

Constraint Table Entries( row8 ):
Name Type Expression isNullable

Mapper table Properties( row9 ):
Properties Values
Name row9
Matching-mode UNIQUE_MATCH
isMinimized false
isReject false
isRejectInnerJoin false
isInnerJoin false

Metadata Table Entries( row9 ):
Name Type Expression isNullable
matnrStringrow2.matnr true
umrenFloattrue

Constraint Table Entries( row9 ):
Name Type Expression isNullable

Mapper table Properties( row16 ):
Properties Values
Name row16
Matching-mode UNIQUE_MATCH
isMinimized false
isReject false
isRejectInnerJoin false
isInnerJoin false

Metadata Table Entries( row16 ):
Name Type Expression isNullable
msehiStringrow2.meins false
mseh3Stringfalse

Constraint Table Entries( row16 ):
Name Type Expression isNullable

Mapper table for tMap_1 ( output ):
Mapper table Properties( row3 ):
Properties Values
Name row3
Matching-mode
isMinimized false
isReject false
isRejectInnerJoin false
isInnerJoin false

Metadata Table Entries( row3 ):
Name Type Expression isNullable
material_idlongLong.valueOf(StringHandling.RIGHT(row2.matnr,7)) false
material_descStringStringHandling.UPCASE(row6.maktx) false
familia_idshortShort.valueOf(row2.matkl) false
familia_descStringStringHandling.UPCASE(row5.wgbez)false
denom_idStringrow8.lbtxt false
variet_idStringrow2.ferth false
formato_idStringrow2.normt false
um_idStringrow16.mseh3 false
litros_idFloatrow9.umren / 1000true
linprod_idshortShort.valueOf(StringHandling.RIGHT(row2.extwg,4)) false
linprod_descStringStringHandling.UPCASE(row7.ewbez)false
target_idStringrow2.wrkst false

Constraint Table Entries( row3 ):
Name Type Expression isNullable

Mapper table Properties( Rechazados ):
Properties Values
Name Rechazados
Matching-mode
isMinimized false
isReject true
isRejectInnerJoin false
isInnerJoin false

Metadata Table Entries( Rechazados ):
Name Type Expression isNullable
material_idlongLong.valueOf(StringHandling.RIGHT(row2.matnr,7)) false
material_descStringStringHandling.UPCASE(row6.maktx) false
familia_idshortShort.valueOf(row2.matkl) false
familia_descStringStringHandling.UPCASE(row5.wgbez) false
denom_idStringrow8.lbtxt false
variet_idStringrow2.ferth false
formato_idStringrow2.normt false
um_idStringrow16.mseh3 false
litros_idFloatFloat.valueOf("0.750")true
linprod_idshortShort.valueOf(StringHandling.RIGHT(row2.extwg,4)) false
linprod_descStringStringHandling.UPCASE(row7.ewbez) false
target_idStringrow2.wrkst false

Constraint Table Entries( Rechazados ):
Name Type Expression isNullable

Mapper table for tMap_1 ( var ):
Mapper table Properties( Var ):
Properties Values
Name Var
Matching-mode
isMinimized true
isReject false
isRejectInnerJoin false
isInnerJoin false

Metadata Table Entries( Var ):
Name Type Expression isNullable

Constraint Table Entries( Var ):
Name Type Expression isNullable

Component:   tMap

      UNIQUE NAME tMap_2 INPUT(S) tMap_2,  tMysqlInput_2
LABEL VERIF_MODIFICACIONES OUTPUT(S) tFlowMeter_21

No image available



Component Parameters:
Properties Values
tStatCatcher Statistics
false
Mapping links display as:
AUTO
Temp data directory path:
Max buffer size (nb of rows):
2000000
Show Information
false
Comentario

Mapper table for tMap_2 ( input ):
Mapper table Properties( row11 ):
Properties Values
Name row11
Matching-mode UNIQUE_MATCH
isMinimized false
isReject false
isRejectInnerJoin false
isInnerJoin false

Metadata Table Entries( row11 ):
Name Type Expression isNullable
material_idlongfalse
material_descStringfalse
familia_idshortfalse
familia_descStringfalse
denom_idStringfalse
variet_idStringfalse
formato_idStringfalse
um_idStringfalse
litros_idfloatfalse
linprod_idshortfalse
linprod_descStringfalse
target_idStringfalse

Constraint Table Entries( row11 ):
Name Type Expression isNullable

Mapper table Properties( row15 ):
Properties Values
Name row15
Matching-mode UNIQUE_MATCH
isMinimized false
isReject false
isRejectInnerJoin false
isInnerJoin false

Metadata Table Entries( row15 ):
Name Type Expression isNullable
material_idlongrow11.material_id false
material_descStringfalse
familia_idshortfalse
familia_descStringfalse
denom_idStringfalse
variet_idStringfalse
formato_idStringfalse
um_idStringfalse
litros_idfloatfalse
linprod_idshortfalse
linprod_descStringfalse
target_idStringfalse

Constraint Table Entries( row15 ):
Name Type Expression isNullable

Mapper table for tMap_2 ( output ):
Mapper table Properties( modificados ):
Properties Values
Name modificados
Matching-mode
isMinimized false
isReject false
isRejectInnerJoin false
isInnerJoin false

Metadata Table Entries( modificados ):
Name Type Expression isNullable
material_idlongrow11.material_id false
material_descStringrow11.material_desc false
familia_idshortrow11.familia_id false
familia_descStringrow11.familia_desc false
denom_idStringrow11.denom_id false
variet_idStringrow11.variet_id false
formato_idStringrow11.formato_id false
um_idStringrow11.um_id false
litros_idfloatrow11.litros_id false
linprod_idshortrow11.linprod_id false
linprod_descStringrow11.linprod_desc false
target_idStringrow11.target_id false

Constraint Table Entries( modificados ):
Name Type Expression isNullable

Mapper table for tMap_2 ( var ):
Mapper table Properties( Var ):
Properties Values
Name Var
Matching-mode
isMinimized true
isReject false
isRejectInnerJoin false
isInnerJoin false

Metadata Table Entries( Var ):
Name Type Expression isNullable

Constraint Table Entries( Var ):
Name Type Expression isNullable