<div><font color="#000099">Thanks Larry.</font></div>
<div><font color="#000099"></font> </div>
<div><font color="#000099">Please see response inline. I am not an expert, in learning stage, so please bear with me if I am asking very basic questions.</font></div>
<div><font color="#000099"></font> </div>
<div><font color="#000099">Regards,</font></div>
<div><font color="#000099">Austin</font></div>
<div><br><br> </div>
<div class="gmail_quote">On Mon, Mar 7, 2011 at 4:14 AM, Larry Garfield <span dir="ltr"><<a href="mailto:larry@garfieldtech.com">larry@garfieldtech.com</a>></span> wrote:<br>
<blockquote style="BORDER-LEFT: #ccc 1px solid; MARGIN: 0px 0px 0px 0.8ex; PADDING-LEFT: 1ex" class="gmail_quote">Is this data that must be managed through Drupal directly? If so, what level<br>of flexibility do you need with it?<br>
<br></blockquote>
<div> </div>
<div><font color="#000099">[Austin]</font></div>
<div><font color="#000099">I do not mind if Drupal can manage data directly. Here the only concern is performance. While adding data, it should be faster and more importantly, while seraching one should be able to search quickly (given huge number of record).</font></div>
<div> </div>
<blockquote style="BORDER-LEFT: #ccc 1px solid; MARGIN: 0px 0px 0px 0.8ex; PADDING-LEFT: 1ex" class="gmail_quote">Is this data coming in from an existing 3rd party source? If so, why does it<br>need to live in Drupal? Can you get away with leveraging the existing data<br>
source?<br></blockquote>
<div> </div>
<div> </div>
<div><font color="#000099">[Austin] </font></div>
<div><font color="#000099">Data is not from 3rd party. Over the period of time, I really hope number of users will increase.</font></div>
<div> </div>
<blockquote style="BORDER-LEFT: #ccc 1px solid; MARGIN: 0px 0px 0px 0.8ex; PADDING-LEFT: 1ex" class="gmail_quote"><br>Assuming your number is in fact 70 million records (if you have that many<br>resumes I really have to wonder who your recruiter is... <g>), then it really<br>
hinges on what "skill set" means. A properly tuned SQL table should handle<br>that many records if you add the right indexes and give it enough RAM, but if<br>skill set is a very complex concept then that may not work. If skill set is<br>
an unpredictable structure, you may be better off looking at a Document DB<br>such as MongoDB or Cassandra.<br><br></blockquote>
<div> </div>
<div><font color="#000099">[Austin]</font></div>
<div><font color="#000099">Skill set is basically comma (",") separated values. Example - PHP, SQL, Drupal, VoIP, SIP, HTTP etc.</font></div>
<div><font color="#000099">This is the field that will be used during searching of records instead of using resume just to have improved performance. </font></div>
<div> </div>
<div> </div>
<blockquote style="BORDER-LEFT: #ccc 1px solid; MARGIN: 0px 0px 0px 0.8ex; PADDING-LEFT: 1ex" class="gmail_quote">The degree to which you need to manage that data through Drupal rather than<br>just search it is also a major factor.<br>
<br></blockquote>
<div><font color="#000099">[Austin]</font></div>
<div><font color="#000099">The data addition, delete and search are the major operations.</font></div>
<div><font color="#000099">If you can think any other data operations (which I might be missing) , really appreciate if you can share.</font></div>
<div> </div>
<div><font color="#000099">Is there any way, where I can compress the resume and store as zip file, when somebody really wants it unzip and give it.</font></div>
<div><font color="#000099">This may be usefull to save memory to great extent.</font></div>
<div> </div>
<div> </div>
<blockquote style="BORDER-LEFT: #ccc 1px solid; MARGIN: 0px 0px 0px 0.8ex; PADDING-LEFT: 1ex" class="gmail_quote">So "needs more info". Also be aware that DrupalCon is this week (the big<br>Drupal dev conference), so most people on the list will be quite busy this<br>
week. You may not get a very rapid reply. :-)<br><font color="#888888"><br>--Larry Garfield<br></font>
<div>
<div></div>
<div class="h5"><br>On Sunday, March 06, 2011 4:20:47 pm Austin Einter wrote:<br>> Hi<br>> I am looking at storing huge data in database (approximately 70,000,00<br>> records).<br>> Each record consists of<br>
><br>> 1. Name<br>> 2. Contact number<br>> 3. Resume (may vary from 50KB to 150KB)<br>> 4. Skill set<br>><br>> And when a user(having role based permission) wants to search database and<br>> retreive those user's record having certain skill set, should able to<br>
> perform as quick as possible and show it in a view.<br>><br>> Please suggest me if any such modules are available or need to be<br>> developed.<br>><br>> For front end interface I am looking at webform. Do you have a better<br>
> suggestion please recomond.<br>><br>> Is there any books/links available , which can guide for efficient<br>> solution, please let me know.<br>><br>> Best Regards<br>> Austin<br></div></div></blockquote>
</div><br>