Received: from localhost (unknown [200.46.204.183]) by developer.postgresql.org (Postfix) with ESMTP id 5908B2E002D for ; Sat, 24 May 2008 15:50:52 -0300 (ADT) Received: from developer.postgresql.org ([200.46.204.71]) by localhost (mx1.hub.org [200.46.204.183]) (amavisd-maia, port 10024) with ESMTP id 85217-06 for ; Sat, 24 May 2008 15:50:47 -0300 (ADT) X-Greylist: from auto-whitelisted by SQLgrey-1.7.6 Received: from noel.decibel.org (noel.decibel.org [67.100.216.10]) by developer.postgresql.org (Postfix) with ESMTP id 4FE7B2E003F for ; Sat, 24 May 2008 15:50:49 -0300 (ADT) Received: from [68.241.231.116] (68-241-231-116.area5.spcsdns.net [68.241.231.116]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by noel.decibel.org (Postfix) with ESMTP id 9D26D564CD; Sat, 24 May 2008 13:50:45 -0500 (CDT) In-Reply-To: <20080411142543.GA6442@alvh.no-ip.org> References: <20080411142543.GA6442@alvh.no-ip.org> Mime-Version: 1.0 (Apple Message framework v753) Content-Type: multipart/signed; micalg=sha1; boundary=Apple-Mail-4--731882345; protocol="application/pkcs7-signature" Message-Id: Cc: Jon Stewart , pgsql-performance@postgresql.org From: Decibel! Subject: Re: Creating large database of MD5 hash values Date: Sat, 24 May 2008 13:43:51 -0400 To: Alvaro Herrera X-Mailer: Apple Mail (2.753) X-Virus-Scanned: Maia Mailguard 1.0.1 X-Archive-Number: 200805/324 X-Sequence-Number: 30292 --Apple-Mail-4--731882345 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII; delsp=yes; format=flowed On Apr 11, 2008, at 10:25 AM, Alvaro Herrera wrote: Sorry, yes, I'm behind on email... :( > If MD5 values will be your primary data and you'll be storing millions > of them, it would be wise to create your own datatype and operators > with > the most compact and efficient representation possible. If you do this *please* post it. I really think it would be worth while for us to have fixed-size data types for common forms of binary data; MD5, SHA1 and SHA256 come to mind. -- Decibel!, aka Jim C. Nasby, Database Architect decibel@decibel.org Give your computer some brain candy! www.distributed.net Team #1828 --Apple-Mail-4--731882345 Content-Transfer-Encoding: base64 Content-Type: application/pkcs7-signature; name=smime.p7s Content-Disposition: attachment; filename=smime.p7s MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIGtTCCAz8w ggKooAMCAQICAQ0wDQYJKoZIhvcNAQEFBQAwgdExCzAJBgNVBAYTAlpBMRUwEwYDVQQIEwxXZXN0 ZXJuIENhcGUxEjAQBgNVBAcTCUNhcGUgVG93bjEaMBgGA1UEChMRVGhhd3RlIENvbnN1bHRpbmcx KDAmBgNVBAsTH0NlcnRpZmljYXRpb24gU2VydmljZXMgRGl2aXNpb24xJDAiBgNVBAMTG1RoYXd0 ZSBQZXJzb25hbCBGcmVlbWFpbCBDQTErMCkGCSqGSIb3DQEJARYccGVyc29uYWwtZnJlZW1haWxA dGhhd3RlLmNvbTAeFw0wMzA3MTcwMDAwMDBaFw0xMzA3MTYyMzU5NTlaMGIxCzAJBgNVBAYTAlpB MSUwIwYDVQQKExxUaGF3dGUgQ29uc3VsdGluZyAoUHR5KSBMdGQuMSwwKgYDVQQDEyNUaGF3dGUg UGVyc29uYWwgRnJlZW1haWwgSXNzdWluZyBDQTCBnzANBgkqhkiG9w0BAQEFAAOBjQAwgYkCgYEA xKY8VXNV+065yplaHmjAdQRwnd/p/6Me7L3N9VvyGna9fww6YfK/Uc4B1OVQCjDXAmNaLIkVcI7d yfArhVqqP3FWy688Cwfn8R+RNiQqE88r1fOCdz0Dviv+uxg+B79AgAJk16emu59l0cUqVIUPSAR/ p7bRPGEEQB5kGXJgt/sCAwEAAaOBlDCBkTASBgNVHRMBAf8ECDAGAQH/AgEAMEMGA1UdHwQ8MDow OKA2oDSGMmh0dHA6Ly9jcmwudGhhd3RlLmNvbS9UaGF3dGVQZXJzb25hbEZyZWVtYWlsQ0EuY3Js MAsGA1UdDwQEAwIBBjApBgNVHREEIjAgpB4wHDEaMBgGA1UEAxMRUHJpdmF0ZUxhYmVsMi0xMzgw DQYJKoZIhvcNAQEFBQADgYEASIzRUIPqCy7MDaNmrGcPf6+svsIXoUOWlJ1/TCG4+DYfqi2fNi/A 9BxQIJNwPP2t4WFiw9k6GX6EsZkbAMUaC4J0niVQlGLH2ydxVyWN3amcOY6MIE9lX5Xa9/eH1sYI Tq726jTlEBpbNU1341YheILcIRk13iSx0x1G/11fZU8wggNuMIIC16ADAgECAhACpH6ZVSGg5xZh 5O/wRN/4MA0GCSqGSIb3DQEBBQUAMGIxCzAJBgNVBAYTAlpBMSUwIwYDVQQKExxUaGF3dGUgQ29u c3VsdGluZyAoUHR5KSBMdGQuMSwwKgYDVQQDEyNUaGF3dGUgUGVyc29uYWwgRnJlZW1haWwgSXNz dWluZyBDQTAeFw0wNzEwMjkxOTE0NDdaFw0wODEwMjgxOTE0NDdaMIGqMQ4wDAYDVQQEEwVOYXNi eTETMBEGA1UEKhMKSmFtZXMgQ2FybDEZMBcGA1UEAxMQSmFtZXMgQ2FybCBOYXNieTEcMBoGCSqG SIb3DQEJARYNamltQG5hc2J5Lm5ldDEiMCAGCSqGSIb3DQEJARYTZGVjaWJlbEBkZWNpYmVsLm9y ZzEmMCQGCSqGSIb3DQEJARYXZGVjaWJlbEBkaXN0cmlidXRlZC5uZXQwggEiMA0GCSqGSIb3DQEB AQUAA4IBDwAwggEKAoIBAQDSgNcbvYYycE3FBX+z9i9zXtQxBalsoeDP92/jSG30Pq6HMlir3+lu rgZd5wBHRt/DMj+5ZfUDY9zQ7hfUio/WKQxRkXH46deV5xh9KNFf8kgxLiLKOBpesWFaXvNlnxU9 JKEpNZUnWeE8N/2mMWWs9L0Rfq0AxYa8TPfsbklALy1n9fY2yU1dNoT/s5tjRQK0UvzElimzMlOK 5PQuZ4atL9Jl6WCZb8811Qr+VUCFWz3e7HCgYDygwL+lBHlXEOLXPJ/lB8l61ugeooGjvuVdsaNf pM30pi5mwRECfOxo9zUL6uCHT6f4Dir6DsOIsTLb4N/vQjz+SGrLwtavSwRTAgMBAAGjWDBWMEYG A1UdEQQ/MD2BDWppbUBuYXNieS5uZXSBE2RlY2liZWxAZGVjaWJlbC5vcmeBF2RlY2liZWxAZGlz dHJpYnV0ZWQubmV0MAwGA1UdEwEB/wQCMAAwDQYJKoZIhvcNAQEFBQADgYEApk/O70t8/38Jkp0M 9ywgSU2kn7w+Z3JN39pH3PnrLjmYV7D//2zJavR3zrZ4AeH2TDc/ioQTk1unfOYroYl+jUKD8NvU 8hbelR8pr+4hKMDx3+6plhKL0ZI9Zbw9DaJcZ3o8QK5fNGQooiz5+aCntbxdD81qG7+lkjQUUcvC wI0xggMQMIIDDAIBATB2MGIxCzAJBgNVBAYTAlpBMSUwIwYDVQQKExxUaGF3dGUgQ29uc3VsdGlu ZyAoUHR5KSBMdGQuMSwwKgYDVQQDEyNUaGF3dGUgUGVyc29uYWwgRnJlZW1haWwgSXNzdWluZyBD QQIQAqR+mVUhoOcWYeTv8ETf+DAJBgUrDgMCGgUAoIIBbzAYBgkqhkiG9w0BCQMxCwYJKoZIhvcN AQcBMBwGCSqGSIb3DQEJBTEPFw0wODA1MjQxNzQzNTJaMCMGCSqGSIb3DQEJBDEWBBRNpYByQ2My QmPkyKEeBOTT8nl+FzCBhQYJKwYBBAGCNxAEMXgwdjBiMQswCQYDVQQGEwJaQTElMCMGA1UEChMc VGhhd3RlIENvbnN1bHRpbmcgKFB0eSkgTHRkLjEsMCoGA1UEAxMjVGhhd3RlIFBlcnNvbmFsIEZy ZWVtYWlsIElzc3VpbmcgQ0ECEAKkfplVIaDnFmHk7/BE3/gwgYcGCyqGSIb3DQEJEAILMXigdjBi MQswCQYDVQQGEwJaQTElMCMGA1UEChMcVGhhd3RlIENvbnN1bHRpbmcgKFB0eSkgTHRkLjEsMCoG A1UEAxMjVGhhd3RlIFBlcnNvbmFsIEZyZWVtYWlsIElzc3VpbmcgQ0ECEAKkfplVIaDnFmHk7/BE 3/gwDQYJKoZIhvcNAQEBBQAEggEAr+yPnbDJ92wAmuB0DdkO9lfTFHhtUg7XoTE9qvOUuEiVlQmx Jo2WUlyTd98hf3Emzy4OWujT2DyJklYWWIOVsiTmaaEkBc4znT2vlgpnePhfEt3WoZVwT/qysL30 bzmgqeqB3/8UiO0is2K5bxgGSrDHknpN03QUeLOw/971pO8dqNIXGoDi2rF9ibSERcT47Ohqf6hy 4pFp820kqejW3EFclljterhdnsn7eQiAoa7MFr4cwGSQZoXHzRMmON9tSgGpboq9NiBqKLhmOI/q dDZqM2BbBZa56Oq1FXHP1+/Tbx+u50NRfjj8HAzcVUszIV1ruEzMdvLhsH6Su0p6PwAAAAAAAA== --Apple-Mail-4--731882345--