How to avoid memory problems when running php mongodb aggregate group function? -

-

i'm running memory problems when try group list field.

input: it's list of items category , fields:

{ category: "catname1", field1: "value11", field2: "value21", ... }, { category: "catname2", field1: "value12", field2: "value22", ... }, { category: "catname3", field1: "value13", field2: "value23", ... }, { category: "catname4", field1: "value14", field2: "value24", ... }, ..

output: should list of categories, each list of corresponding items:

{ category: "catname1", items: [     { field1: "value12", field2: "value22", ... },     { field1: "value14", field2: "value24", ... }, .. ] }, { category: "catname2", items: [     { field1: "value12", field2: "value22", ... },     { field1: "value14", field2: "value24", ... }, .. ] },

//edit: tried different versions, removed 1 better readability.

partial solution: works small lists, runs out of memory when have 1000 categories 1000 items each. :(

$cursor = $collection->aggregate(     array(         array(             '$match' => array(                 .. filters here ...             ) ),         array(             '$group' => array(                     '_id' => '$category',                     'items' => array( '$addtoset' => array(                         'field1' => '$field1',                         'field2' => '$field2',                         'field3' => '$field3',                         'field4' => '$field4'                     ) ) ) ) ) );

when try input list beginning, works fine. try group them somehow fails. ideas why or how fix it?

you schema exact copy of people use in sql environment.

try changing schema to

{     "category": "cat1",     "values": {         "item1": "value1",         "item1": "value2"     }  }

this should work fine long number of different keys not grow above 100 or 1000.


Comments

Post a Comment

Popular posts from this blog

windows - Single EXE to Install Python Standalone Executable for Easy Distribution -

-
i used pyinstaller create standalone exe file pyqt project. did not use single file option because exe created single file option takes long open. therefore, pyinstaller created dist folder contains bunch of files including program.exe file. create setup.exe file place contents of dist folder in program directory , create shortcut in start menu , on desktop. want super simple user. maybe setup.exe files when download program cnet. found inno-setup, looks promising. however, not know if there special considerations because program standalone program create python/pyqt program. thanks! have experience task? there program using task not know about? inno-setup or nsis easiest use. tell them files include , put them , create nice installer you. wrote short tutorial on experiences using innosetup might find helpful: http://www.blog.pythonlibrary.org/2008/08/27/packaging-wxpymail-for-distribution/ note tutorial based around wxpython app wrote, concepts same.
Read more

c# - Access objects in UserControl from MainWindow in WPF -

-
i have simple xaml, how can change text property of textblock in usercontrol1 mainwindow ? <window x:class="refactorxaml.mainwindow" xmlns="http://schemas.microsoft.com/winfx/2006/xaml/presentation" xmlns:x="http://schemas.microsoft.com/winfx/2006/xaml" xmlns:refactorxaml="clr-namespace:refactorxaml" title="mainwindow" height="350" width="525"> <grid> <grid.rowdefinitions> <rowdefinition height="100"></rowdefinition> <rowdefinition height="100"></rowdefinition> </grid.rowdefinitions> <grid> <refactorxaml:usercontrol1></refactorxaml:usercontrol1> </grid> <grid grid.row="1"> <button>change text</button> </grid> </grid> </window> <usercon...
Read more

javascript - How to name a jQuery function to make a browser's back button work? -

-
i'm trying write function ajaxyfy web site, works perfect, except function button. that's have now: function loading() { if (typeof history.pushstate !== "undefined") { var historycount = 0; $('.menu-item, .logo').on('click','a',function(e){ e.preventdefault(); $(this).data('clicked', true); if ($(this).is('.logo a')) { var homepage = $(this).attr('href'); function1(homepage); history.pushstate(null, null, homepage); } else if ($(this).is('.projects a')) { var projects = $(this).attr('href'); function2(projects); history.pushstate(null, null, projects); } else { var pages = $(this).attr('href'); function3(pages); history.pushstate(null, null, pages); ...
Read more