0000526: Large tabular catalogues may use excessive RAM

feature request / bug tracker

View Issue Details [ Jump to Notes ]

[ Issue History ] [ Print ]

Project

Category

View Status

Date Submitted

Last Update

0000526

ocPortal

[All Projects] General

public

2012-05-27 17:25

Reporter

Chris Graham

Assigned To

Chris Graham

Priority

high

Severity

minor

Reproducibility

always

Status

resolved

Resolution

fixed

Platform

OS Version

Product Version

Target Version

Fixed in Version

Summary

0000526: Large tabular catalogues may use excessive RAM

Description

ocPortal tries to limit RAM used by tabular catalogues by flattening the Tempcode tree for each table row. However the Tempcode engine still can use a lot of memory when large numbers of flattened rows are appended. PHP generally is a real memory hog due to the way it stores loosely-typed dynamic data structures.

Refactor the Tempcode engine so that concatenated flattened segments are done as a single string sequence by detecting the intention for optimisation and being clever about manipulating how things are concatenated.

Tags

No tags attached.

Time estimation (hours)

Attached Files

hotfix-526, 2012-05-27 10pm.tar [^] (61,440 bytes) 2012-05-27 17:25

hotfix-526, 2012-05-27 11pm.tar [^] (61,440 bytes) 2012-05-27 18:49

Relationships

Notes
(0000561) Chris Graham (administrator) 2012-05-27 17:25	Fixed in git commit f5de557 (https://github.com/chrisgraham/ocPortal/commit/f5de557 [^] - link will become active once code pushed) A hotfix (a TAR of files to upload) have been uploaded to this issue. These files are made to the latest intra-version state (i.e. may roll in earlier fixes too if made to the same files) - so only upload files newer than what you have already. Always take backups of files you are replacing or keep a copy of the manual installer for your version, and only apply fixes you need. These hotfixes are not necessarily reliable or well supported. Not sure how to extract TAR files to your Windows computer? Try 7-zip (http://www.7-zip.org/ [^]).

(0000562) Chris Graham (administrator) 2012-05-27 18:49	Automated response: Tempcode optimisation not stable The Tempcode optimisation made in 0000526 doesn't always work. Fix failure case.

(0000563) Chris Graham (administrator) 2012-05-27 18:49	Fixed in git commit af060a5 (https://github.com/chrisgraham/ocPortal/commit/af060a5 [^] - link will become active once code pushed) A hotfix (a TAR of files to upload) have been uploaded to this issue. These files are made to the latest intra-version state (i.e. may roll in earlier fixes too if made to the same files) - so only upload files newer than what you have already. Always take backups of files you are replacing or keep a copy of the manual installer for your version, and only apply fixes you need. These hotfixes are not necessarily reliable or well supported. Not sure how to extract TAR files to your Windows computer? Try 7-zip (http://www.7-zip.org/ [^]).

Issue History
Date Modified	Username	Field	Change