xdmod ticket #31293 Any suggestions to set up the Realms?

[rob-baron]

Robert Bartlett Baron, reported 11 months ago
/usr/share/xdmod/tools/etl/etl_overseer.php -p ingest-resources
2022-09-26 19:16:48 [notice] dw_extract_transform_load start (process_start_time: 2022-09-26 19:16:48)
2022-09-26 19:16:54 [notice] Start processing section 'xdmod.ingest-resources'
2022-09-26 19:16:55 [notice] (action: xdmod.ingest-resources.IngestResourceConfig (ETL\Ingestor\StructuredFileIngestor), start_time: 1664219814.9337, end_time: 1664219815.3074, elapsed_time: 0.37369, records_examined: 4, records_loaded: 4)
2022-09-26 19:16:56 [notice] (action: xdmod.ingest-resources.IngestResourcesStaging (ETL\Ingestor\DatabaseIngestor), start_time: 1664219815.647, end_time: 1664219815.9491, elapsed_time: 0.30211, records_examined: 0, records_loaded: 0)
2022-09-26 19:16:56 [notice] (action: xdmod.ingest-resources.HpcdbIngestResources (ETL\Ingestor\DatabaseIngestor), start_time: 1664219816.3036, end_time: 1664219816.609, elapsed_time: 0.30541, records_examined: 0, records_loaded: 0)
2022-09-26 19:16:57 [notice] (action: xdmod.ingest-resources.IngestResourcefact (ETL\Ingestor\DatabaseIngestor), start_time: 1664219817.0306, end_time: 1664219817.3012, elapsed_time: 0.27058, records_examined: 0, records_loaded: 0)
2022-09-26 19:16:58 [notice] (action: xdmod.ingest-resources.IngestResourceTypeRealmRelationsStaging (ETL\Ingestor\StructuredFileIngestor), start_time: 1664219817.6522, end_time: 1664219818.3558, elapsed_time: 0.70361, records_examined: 9, records_loaded: 9)
2022-09-26 19:16:59 [error] {"message":"xdmod.ingest-resources.IngestInitialRealms (ETL\Ingestor\DatabaseIngestor): SQLSTATE[23000]: Integrity constraint violation: 1452 Cannot add or update a child row: a foreign key constraint fails (moddb.realms, CONSTRAINT fk_r_module_id FOREIGN KEY (module_id) REFERENCES modules (module_id) ON DELETE CASCADE) Exception: 'SQLSTATE[23000]: Integrity constraint violation: 1452 Cannot add or update a child row: a foreign key constraint fails (moddb.realms, CONSTRAINT fk_r_module_id FOREIGN KEY (module_id) REFERENCES modules (module_id) ON DELETE CASCADE)'"}
2022-09-26 19:16:59 [warning] Stopping ETL due to exception in xdmod.ingest-resources.IngestInitialRealms (ETL\Ingestor\DatabaseIngestor)
2022-09-26 19:16:59 [error] xdmod.ingest-resources.IngestInitialRealms (ETL\Ingestor\DatabaseIngestor): SQLSTATE[23000]: Integrity constraint violation: 1452 Cannot add or update a child row: a foreign key constraint fails (moddb.realms, CONSTRAINT fk_r_module_id FOREIGN KEY (module_id) REFERENCES modules (module_id) ON DELETE CASCADE) Exception: 'SQLSTATE[23000]: Integrity constraint violation: 1452 Cannot add or update a child row: a foreign key constraint fails (moddb.realms, CONSTRAINT fk_r_module_id FOREIGN KEY (module_id) REFERENCES modules (module_id) ON DELETE CASCADE)'
#0 /usr/share/xdmod/classes/ETL/Ingestor/pdoIngestor.php(544): CCR\Loggable->logAndThrowException('SQLSTATE[23000]...', Array)
#1 /usr/share/xdmod/classes/ETL/Ingestor/pdoIngestor.php(459): ETL\Ingestor\pdoIngestor->singleDatabaseIngest()
#2 /usr/share/xdmod/classes/ETL/Ingestor/aIngestor.php(126): ETL\Ingestor\pdoIngestor->_execute()
#3 /usr/share/xdmod/classes/ETL/EtlOverseer.php(473): ETL\Ingestor\aIngestor->execute(Object(ETL\EtlOverseerOptions))
#4 /usr/share/xdmod/classes/ETL/EtlOverseer.php(435): ETL\EtlOverseer->_execute('xdmod.ingest-re...', Object(ETL\Ingestor\DatabaseIngestor))
#5 /usr/share/xdmod/tools/etl/etl_overseer.php(608): ETL\EtlOverseer->execute(Object(ETL\Configuration\EtlConfiguration))
#6 {main}
xdmod.ingest-resources.IngestInitialRealms (ETL\Ingestor\DatabaseIngestor): SQLSTATE[23000]: Integrity constraint violation: 1452 Cannot add or update a child row: a foreign key constraint fails (moddb.realms, CONSTRAINT fk_r_module_id FOREIGN KEY (module_id) REFERENCES modules (module_id) ON DELETE CASCADE) Exception: 'SQLSTATE[23000]: Integrity constraint violation: 1452 Cannot add or update a child row: a foreign key constraint fails (moddb.realms, CONSTRAINT fk_r_module_id FOREIGN KEY (module_id) REFERENCES modules (module_id) ON DELETE CASCADE)'
#0 /usr/share/xdmod/classes/ETL/Ingestor/pdoIngestor.php(544): CCR\Loggable->logAndThrowException('SQLSTATE[23000]...', Array)
#1 /usr/share/xdmod/classes/ETL/Ingestor/pdoIngestor.php(459): ETL\Ingestor\pdoIngestor->singleDatabaseIngest()
#2 /usr/share/xdmod/classes/ETL/Ingestor/aIngestor.php(126): ETL\Ingestor\pdoIngestor->_execute()
#3 /usr/share/xdmod/classes/ETL/EtlOverseer.php(473): ETL\Ingestor\aIngestor->execute(Object(ETL\EtlOverseerOptions))
#4 /usr/share/xdmod/classes/ETL/EtlOverseer.php(435): ETL\EtlOverseer->_execute('xdmod.ingest-re...', Object(ETL\Ingestor\DatabaseIngestor))
#5 /usr/share/xdmod/tools/etl/etl_overseer.php(608): ETL\EtlOverseer->execute(Object(ETL\Configuration\EtlConfiguration))
#6 {main}
Ryan Rathsam , said 11 months ago
Ticket: https://help.xdmod.org/support/tickets/31293

Hi Robert,

If you've already run xdmod-setup, then I would manually run acl-config.

Thanks,

Ryan

Robert Bartlett Baron , said 11 months ago
Ryan,

Ryan,

Thanks, That worked.

When should acl-config normally run?

Can it be run twice?

Rob.
Ryan Rathsam , said 11 months ago
Cc: [email protected]
Ticket: https://help.xdmod.org/support/tickets/31293

Hi Rob,
​
Normally acl-config should normally be run in one of a couple of situations:

• You're just getting things setup and there was maybe some funkiness during the db setup portion of xdmod-setup ( acl-config runs at the end off this step )
• There have been changes made to any of the files in [/etc/xdmod|/path/to/xdmod/etc]/ ( location differs depending on how XDMoD is installed ):
  • roles.json or roles.d/**
  • datawarehouse.json or datawarehouse.d/**
    ​
    And yeah, you should be able to run it any number of times without any adverse effects.

Thanks!

Ryan

Robert Bartlett Baron , said 3 months ago
thanks, I think I got beyond this a little bit.

I think we can close this issue for now.