December 2005 - Development - lists.drupal.org

why locale import is slow and a memory eater?
by Gabor Hojtsy 02 Feb '06

02 Feb '06

Hi, Dries asked me to look into this for 4.7.0, since those with low memory settings or slow servers experience problems importing PO files. The issue is quite simple: - the import script loads in the complete file into a string (in an uberly complicated way :) - then it splits the string into $lines (into another variable) on which it does the processing - while processing the file, it builds up a $strings array which contains all the parsed information from the $lines array @ at this point, there are three copies of the po file in memory, taking up increasly more space: single string < line-by-line array < parsed array - all the above is done in a function, so when the function returns, the three copies of the file reduces to one (the returned $strings array), which is then processed element by element, and the database is modified accordingly It would be really straightforward to read the file line by line, which should get off a lot of burden from PHP (at least a megabyte of text, plus the overhead of the $lines array structure). That eliminates the first two steps. But then the best would be to directly process the PO tokens as parsed (ie. hand over information to the database as soon as possible, and do not keep a big array of this data in memory). And here comes the question. Now, if a PO file is broken for any reason, the real SQL import process is skipped. But whether the file is broken at some point is only possible to tell, if we parse the file up to that point. If the SQL changes are made incrementally, then the PO file would end up half-imported. Question is if it is a problem or not. I think this is a minor problem, since you are supposed to upload a translation which you are about to use, so if your po file is broken it is not a problem that it is half imported, you should fix and try again. I cannot provide an estimate on when will I have the time to work on this, but the file reading methods seem to be perfect low hanging fruit, even if the more direct SQL import is a bit more time to do. Let us clear up first that the incremental SQL import is sufficient. BTW first to upload files on a hosted environment, this open_basedir compatibility patch needs to get it: http://drupal.org/node/5961 Happy New Year everybody, Gabor

3 4

Path mapping system
by Karoly Negyesi 18 Jan '06

18 Jan '06

Hi! I talked with Ber about path mappings and here are my ideas: *) We remove arg() calls from most of core and use parameters to callbacks. *) Instead of linking to node/$nid , we have a give_me_a_path('node', $nid) function. On admin UI you can choose which handler deals with 'node' type paths. This handler gets $type ('node', 'comment' whatever) and $id as a parameter and creates a path. This is the crux of the matter: instead of dumb string aliasing what path module does currently we create an 'intelligent' subsystem. *) I first thought that we need to add regular expressions to menu to match incoming paths against but I am not sure. The current system, I think is able. See below for an example. For example, a mapping for the type 'user' could describe itself as 'puts usernames into the path'. After choosing this handler when url gets ('user', $uid) , it would hand over these as parameters to the username_path function which would grab name field from user table and return with the path "username/$name". This is one SQL query against user table which is approximately the same amount of work that path does currently -- but it queries an indexed table with a numeric index. The function url() would call only one mapping function per invocation as it is now, with the only change that this function comes from a variable. A menu callback would handle the path 'username', with an argument of $name. This callback is as simple as loading $uid and calling user_page with it. So I think this subsystem could scale nicely. Of course, this is a LOT and LOT of work because we need to change EVERY l/url in core to be an 'intelligent' call. But the results! Regards Karoly Negyesi

12 14

let's cleanup /misc
by Theodore Serbinski 11 Jan '06

11 Jan '06

As 4.7 continues to grow and new files are added or about to be added (like the forthcoming textarea patch, w00t indeed!), I think it's time for an early spring cleaning on this folder. I recommend the following: delete /misc create: /images /images/logos (for those drupal powered logos) /scripts (merge with shell scripts perhaps?) /styles Thoughts? I think we should make this change before 4.7 ships, it should be relatively simple to do, we just need to agree on the best way to do it. So let's have at it! ted (m3avrck)

23 68

Drupal Hosting
by "Schultz Consult - [René Madsen]" 06 Jan '06

06 Jan '06

Hi Drupal development team, Our company host and develop for drupal. We would like to have a link on http://drupal.org/services/hosting <text for http://drupal.org/services/hosting > Schultz Consult is a Danish company developing for and hosting Drupal sites. Within the drupal site you would get the following: For only 149,- Danish Kroner you would get the following: 149,- Dansih Kroner is approximately 19.96 € - Latest Drupal installation - Unlimited use of webspace - 10 e-mail accounts - 1 database - 5Gb of transfer pr. month. - And loads of more... At the moment our site with information about our Drupal hosting is in Danish, but it will soon be translated into English. You may look at http://www.schultzconsult.dk/node/28 for more information about our Drupal products. Danish version: Schultz Consult er en dansk virksomhed som udvikler til og hoster Drupal. Du vil for kun 149,- pr./md. få følgende: - Seneste Drupal installation - Ubegrænset forbrug af harddiskplads - 10 e-mail konti - 1 database - 5Gb trafik pr./md. - Og meget mere... Du vil kunne læse mere om vores produkt på http://www.schultzconsult.dk/node/28 </end of text> Best Regards René Madsen Schultz Consult phone +45 28 34 36 85 Glanshatten 54b, DK-5220 Odense South East Denmark

3 3

Bridging PHP to Java or C++?
by Mark Fredrickson 05 Jan '06

05 Jan '06

Hi all, For my Machine Learning toolkit, I'm looking to draw on the work of either the Java Weka ML system or the MLC++ library. My question to the Drupal community is: which is easier to bridge (Java or C++) to PHP (and specifically to Drupal)? My vote is for Java, as I can distribute the (GPL'd) bytecode more easily than pre-compiled C++ binaries. Let's take performance off the table for this discussion. My design calls for the ML algorithms to be pluggable via an API to the interaction code, so high perf classifiers could be written later if my selected method proves slow. On a more general note, do any modules currently require php extensions that are not in PEAR? If so, how do they handle getting the module compiled and installed. Thanks, Mark Fredrickson

7 10

the new standard RSS icon
by Theodore Serbinski 05 Jan '06

05 Jan '06

Ok guys, with all of the improvements to the feed system in 4.7, I have one more suggestion to really wrap things up and help Drupal to be forward thinking in this area. There is a new push to standardize the RSS icon, and if you haven't heard, Microsoft, has adopted the *same* icon as Mozilla, that little orange icon. Yes, it's true, something *both* browsers will share in common. Wow, progress, at last! Read more about that here: http://mattbrett.com/archives/2005/12/the-new-standard-feed-icon/ So I motion that we do this for the final release of 4.7, that we include this new icon by default and get rid of the crummy XML icon. If you read that above article, it makes a lot of sense, does the term "XML" mean anything but to developers? We could certainly adopt either an orange or blue icon (could be theme specific, I'll leave that up to guys) but here is the link for icons: http://feedicons.com/ This is not so much a patch but a change in icons so I wanted to throw this out there. If everyone agrees, we can create an issue and get this committed. It should be trivial to implement, but as Drupal 4.7 sites are widely deployed next year, the affects of this icon will be much more impressive. And speaking of which, to go along with this, I think we should throw in a patch that puts this icon in a promiment place, instead of merely at the bottom of the page. Perhaps we can throw this at the top of feed pages (top of the node page for example). Still leave it themeable but change the default a bit. Just my 2 cents. Happy Holidays all! ted (aka m3avrck)

10 12

Drupal 4.7.0 release schedule
by Dries Buytaert 03 Jan '06

03 Jan '06

Hello world, I think I might release a third beta release this week. - If someone wants to help with the release announcement (like merlinofchaos did last time), drop me an e-mail in private. - We fixed about 50 bugs the past 2 weeks. - There are more than 500 patches that need to be reviewed (status: patch needs review). - There are more than 1000 issues against HEAD/4.7 that need attention. - There are 200 critical bugs/patches that need attention. Please focus on the critical issues first: http://drupal.org/project/ issues?projects=3060&priorities=1&states=1,8,13,14 -- Dries Buytaert :: http://www.buytaert.net/

1 1

Block visibility
by Karthik 01 Jan '06

01 Jan '06

Hi, I just noticed the introduction of the option to use PHP code to control visibility (on the block configure page). Is there any documentation on this or any links to the conversation that led to this decision? Besides being IMHO decidedly un-user-friendly, this could very likely lock an admin out of his entire site. I couldn't find any information on drupal.org or in the mailing lists. Apologies if this has already been addressed elsewhere. Thanks Karthik.

3 3

Release critical bugs for December 31, 2005
by drupal-devel＠drupal.org 31 Dec '05

31 Dec '05

/ bug reports Article tag repeating age: 6 weeks 5 days url: http://drupal.org/node/37544 / bug reports email spam filtering does not "see" email addresses when they are NOT preceded by a word age: 49 weeks 6 days url: http://drupal.org/node/15654 / bug reports admin/modules fails to display age: 1 week 4 days url: http://drupal.org/node/41791 / bug reports Getting Buddylist ready for 4.7 age: 5 weeks 2 days url: http://drupal.org/node/38683 / bug reports No check for loading chatbox with other name age: 5 weeks 5 days url: http://drupal.org/node/38397 / bug reports Devel Module Throws Error Messages age: 3 days 21 hours url: http://drupal.org/node/42457 / support requests broken config screen age: 7 weeks 3 days url: http://drupal.org/node/36949 / bug reports Event start/end date section should *not* show first on Submit event page age: 1 week 3 days url: http://drupal.org/node/41869 Drupal Event age: 1 week 4 days url: http://drupal.org/node/41833 Event start and end times not getting saved in database age: 2 weeks 1 day url: http://drupal.org/node/41300 event_calendar_data : warning: gmdate() [function.gmdate]: Windows does not support dates prior to midnight (00:00:00), January age: 3 weeks 1 day url: http://drupal.org/node/40470 Issues with list view for events age: 3 weeks 5 days url: http://drupal.org/node/39943 Database error keeps popping up age: 4 weeks 3 days url: http://drupal.org/node/39396 Events module bugs adding and changeing events age: 4 weeks 6 days url: http://drupal.org/node/39016 / feature requests Checkbox to disable Ical link age: 3 weeks 6 days url: http://drupal.org/node/39848 Events only for registered users age: 10 weeks 2 days url: http://drupal.org/node/34640 / support requests Date problem on calendar, off by a day age: 4 weeks 4 days url: http://drupal.org/node/39193 displaying event start info in flexinode tabular view? age: 12 weeks 4 days url: http://drupal.org/node/33019 Event block missing content of many fields age: 14 weeks 6 days url: http://drupal.org/node/31532 / bug reports file size bug age: 29 weeks 1 day url: http://drupal.org/node/24728 / bug reports Latest patch hosed my G2 integration and G2 Standalone age: 4 weeks 4 days url: http://drupal.org/node/39168 problem viewing newly added photos in embedded gallery. age: 5 weeks 5 days url: http://drupal.org/node/38352 problem viewing newly added photos in embedded gallery. assigned: trobison age: 5 weeks 5 days url: http://drupal.org/node/38351 Search results give incorrect links age: 11 weeks 6 days url: http://drupal.org/node/33539 Full screen slideshow in Gallery module is not working (erroring out on the wrong URL) age: 25 weeks 2 days url: http://drupal.org/node/26479 / support requests Gallery Module stopped working age: 3 weeks 4 days url: http://drupal.org/node/40117 import existing gallery2 user account age: 8 weeks 4 days url: http://drupal.org/node/35920 / feature requests Goofy Forum UI age: 13 weeks 4 days url: http://drupal.org/node/32294 / bug reports Plugin css breaks age: 2 days 19 hours url: http://drupal.org/node/42555 Admin settings fails to store age: 2 days 23 hours url: http://drupal.org/node/42539 / bug reports BMP's don't work age: 1 week 3 days url: http://drupal.org/node/41926 By CHanging the following the error changes assigned: walkah age: 2 weeks 1 day url: http://drupal.org/node/41353 Deleting Image gallery age: 4 weeks 4 days url: http://drupal.org/node/39290 imagemagick.inc file does not contain the function... age: 6 weeks 6 days url: http://drupal.org/node/37372 Error when Submitting New Image Node age: 6 weeks 6 days url: http://drupal.org/node/37366 only variables can be passed by reference on line 713 age: 8 weeks 2 days url: http://drupal.org/node/36092 image.module 4.6.0 strange actions age: 12 weeks 1 day url: http://drupal.org/node/33292 cannot asociate image to the gallery age: 13 weeks 15 hours url: http://drupal.org/node/32723 File copy failed: source file does not exist error after running update-image.php age: 14 weeks 3 days url: http://drupal.org/node/31816 Path for image folder not inserted correctly when nodetype = image age: 17 weeks 3 days url: http://drupal.org/node/30031 image module patch & image_import module age: 18 weeks 5 days url: http://drupal.org/node/29377 image module fails on dual site configuration age: 24 weeks 2 days url: http://drupal.org/node/26657 Cannot upload .jpgs age: 43 weeks 5 days url: http://drupal.org/node/18076 / feature requests Copying original age: 8 weeks 1 day url: http://drupal.org/node/36321 Image deletions? age: 16 weeks 3 days url: http://drupal.org/node/30557 / support requests What does update-image.php do exactly? age: 1 week 14 hours url: http://drupal.org/node/42222 images not showing2 age: 4 weeks 5 hours url: http://drupal.org/node/39773 Image Folder Permissions age: 10 weeks 15 hours url: http://drupal.org/node/34839 Image Module Permissions age: 25 weeks 6 days url: http://drupal.org/node/26280 / bug reports Listhandler caused error in "comment.module on line 996" ? age: 8 weeks 1 day url: http://drupal.org/node/36244 / tasks Correct/Complete Documentation age: 9 weeks 6 days url: http://drupal.org/node/34909 / bug reports Error on retreiving mail age: 4 weeks 4 days url: http://drupal.org/node/39178 / bug reports foreach() assigned: neablo age: 5 days 3 hours url: http://drupal.org/node/42350 / bug reports Error when deleting nodes or in the case below - error when deleting a taxonomy term age: 4 weeks 3 hours url: http://drupal.org/node/39781 / feature requests Description as a tag in the theme. age: 4 weeks 3 days url: http://drupal.org/node/39354 / bug reports nodes are being created with no body age: 3 weeks 2 days url: http://drupal.org/node/40373 missing promote column assigned: Bèr Kessels age: 5 weeks 1 day url: http://drupal.org/node/38836 Naming issues with files and DB tables age: 10 weeks 5 days url: http://drupal.org/node/34298 RSS "no element found at line 1" age: 26 weeks 21 hours url: http://drupal.org/node/26185 Outdated help texts age: 1 year 21 weeks url: http://drupal.org/node/9692 Import doesn't like XML/RSS feeds with no Title element age: 1 year 30 weeks url: http://drupal.org/node/8128 / tasks move XML-parser into an inclde file. age: 27 weeks 4 days url: http://drupal.org/node/25439 / bug reports Notify not playing well with Organic Groups age: 2 weeks 4 days url: http://drupal.org/node/40967 / feature requests Notify.module ignores the true submission queue age: 2 years 9 weeks url: http://drupal.org/node/3765 / bug reports Login as an alias gets cached age: 14 weeks 4 days url: http://drupal.org/node/31699 / bug reports Malformed PDFs age: 5 days 17 hours url: http://drupal.org/node/42312 Drupal 4.7 age: 1 week 3 days url: http://drupal.org/node/41887 support dynamic content? age: 6 weeks 7 hours url: http://drupal.org/node/38181 please explain html2fpdf age: 6 weeks 3 days url: http://drupal.org/node/37748 Management of french charaters age: 7 weeks 5 days url: http://drupal.org/node/36605 / feature requests Internationalization support for PDF assigned: TheLibrarian age: 1 year 39 weeks url: http://drupal.org/node/6795 / bug reports anonymous users can create folders and view all anonymous sent-mail age: 2 weeks 1 day url: http://drupal.org/node/41361 error when trying to send private message age: 3 weeks 13 hours url: http://drupal.org/node/40626 privatemsg not working with current head age: 15 weeks 1 hour url: http://drupal.org/node/31469 Reminder email links don't work age: 27 weeks 1 day url: http://drupal.org/node/25677 / feature requests Simplified Chinese translations age: 6 weeks 5 days url: http://drupal.org/node/37505 / bug reports SQL errors on issues and my projects pages age: 1 week 1 day url: http://drupal.org/node/42160 Blank page on admin/settings/project/status age: 1 week 5 days url: http://drupal.org/node/41646 Issues from multiple projects listed on a single issue's page age: 5 weeks 2 days url: http://drupal.org/node/38704 Get disconnected from server on attempting to add an issue age: 8 weeks 2 days url: http://drupal.org/node/36124 can't select all projects age: 12 weeks 1 day url: http://drupal.org/node/33262 Can't update issue title from issue comment assigned: nedjo age: 12 weeks 5 days url: http://drupal.org/node/32843 Projects not listed and page not complete age: 30 weeks 4 days url: http://drupal.org/node/23956 Date for latest is incorrect age: 37 weeks 2 days url: http://drupal.org/node/20485 / feature requests Need Documentation age: 3 weeks 2 days url: http://drupal.org/node/40392 Search by Version age: 6 weeks 20 hours url: http://drupal.org/node/38122 Allow subscription to individual project issues age: 10 weeks 3 days url: http://drupal.org/node/34496 Implement XML-RPC functionlality for communication between drupal.org and Drupal installations age: 11 weeks 21 hours url: http://drupal.org/node/34108 / support requests Add the project release manually without the scan feature age: 10 weeks 3 days url: http://drupal.org/node/34500 / bug reports Error with URL to recipe age: 17 weeks 5 days url: http://drupal.org/node/29885 / feature requests Request to generate email for all content changes/additions, including comments age: 24 weeks 3 hours url: http://drupal.org/node/26824 / bug reports Wrong URL mask age: 9 weeks 3 days url: http://drupal.org/node/35215 / bug reports taxonomy_dhtml breaks security? age: 3 days 2 hours url: http://drupal.org/node/42531 Does not work correctly in Internet Explorer age: 12 weeks 1 day url: http://drupal.org/node/33354 Blocks switch and reset when vocabs are modified age: 33 weeks 2 days url: http://drupal.org/node/22631 javascrip downloads square.gif for every category age: 45 weeks 4 days url: http://drupal.org/node/17366 / feature requests Compatibility with 4.7 age: 2 days 6 hours url: http://drupal.org/node/42645 A unique page for each category group? age: 10 weeks 2 days url: http://drupal.org/node/34610 / support requests Taxonomy has dissapeared age: 12 weeks 3 days url: http://drupal.org/node/33061 / bug reports Sends trackbacks for unpublished nodes assigned: ankur age: 48 weeks 2 days url: http://drupal.org/node/16239 / bug reports meet age: 2 weeks 4 days url: http://drupal.org/node/40996 411 error when upgrading using Firefox 1.5 age: 3 weeks 23 hours url: http://drupal.org/node/40551 / feature requests A small but effective improvement to Improvement of admin/user accessability suggestion age: 11 weeks 1 day url: http://drupal.org/node/34073 / support requests Fatal Error age: 4 weeks 23 hours url: http://drupal.org/node/39701 Acess denied to login Newly installed and upgraded site that I need up and running A.S.A.P assigned: Johnny age: 5 weeks 6 days url: http://drupal.org/node/38227 / bug reports Resolution appears to be in the cvs version of the linkattach module assigned: hintbw age: 10 weeks 1 day url: http://drupal.org/node/34765

1 0

Review request: issue #39697
by Dries Buytaert 31 Dec '05

31 Dec '05

Can some people have a look at http://drupal.org/node/39697 -- I'd like to include it in the next beta. Thanks. PS: yesterday I fell and injured my wrist; typing is hard/slow so I'll respond to private mails in the next few days. I can only use my left hand. It took me 4-5 hours to review the 20-25 issues I reviewed today. :/ -- Dries Buytaert :: http://www.buytaert.net/

1 0