| An extremely large hash lookup mechanism [message #172232] |
Mon, 07 February 2011 12:06  |
ram
Messages: 4
Registered: February 2011
Karma:
|
Junior Member |
|
|
I have Mysql table with customerid (big int) & customer_unique_key
(varchar )
I have a php script that needs to upload customers into groups.
The customer_unique_key will be uploaded and all the customerids
should be entered to a new table.
Initially My script was doing a per-record query to extract
customerid and print.
But this turned out to be toooo slow , since the upload file may have
upto a million records.
Now I modified the script to read all customer_unique_key ->
customerid as key value pairs into an array
This works fine and fast , but hogs the memory and crashes whenever
the number of records crosses around 3-4 million.
What is the best way I can implement a hash lookup ? Should I use a
CDB library ?
|
|
|
|
Calendar
Search
Help
Members
Register
Login
Home
]