Please register to participate in our discussions with 2 million other members - it's free and quick! Some forums can only be seen by registered members. After you create your account, you'll be able to customize options and access all our 15,000 new posts/day with fewer ads.
I have run computer programs that process 20,000 rows per second and faster.
When the program is searching for specific data, such as a keyword of hillary's emailid, the subset of hillary's emails can easily be determined. In reality, of the 650,000 emails, only a smaller subset was likely related to Hillary's emailid. Since it was Wiener's laptop, the Weiner emails that didn't have any Hillary email keywords were eliminated.
Once Hillary's subset was determined, all via computer searches and comparisons - then the Hillary related emails would go through additional searches/comparisons via computer. Such as doing a comparison looking for duplicates against the subset of emails that the FBI already had before from Hillary. This all is done with high speed computers and high speed complex database searches.
Humans only had to read the emails that were identified to be Hillary's AND identified to NOT be duplicates. This subset was likely small enough to review in a timely manner.
It's 2016 folks. They didn't have to print out 650,000 emails and have humans sitting at desks with highlighters while they manually reviewed every email.
BTW - I am a Software Engineer that specializes in programming database searches, data comparisons, calculations and loads for huge volumes of data for large corporations. High speed processing of massive amounts of data is nothing these days. I can go through 5 billion rows of data in minutes with software tools that are commonly available. I can only imagine the software tools that are used by the FBI - likely top of the line.
Last edited by sware2cod; 11-07-2016 at 06:12 AM..
I have run computer programs that process 20,000 rows per second and faster.
When the program is searching for specific data, such as a keyword of hillary's emailid, the subset of hillary's emails can easily be determined. In reality, of the 650,000 emails, only a smaller subset was likely related to Hillary's emailid. Since it was Wiener's laptop, the Weiner emails that didn't have any Hillary email keywords were eliminated.
Once Hillary's subset was determined, all via computer searches and comparisons - then the Hillary related emails would go through additional searches/comparisons via computer. Such as doing a comparison looking for duplicates against the subset of emails that the FBI already had before from Hillary. This all is done with high speed computers and high speed complex database searches.
Humans only had to read the emails that were identified to be Hillary's AND identified to NOT be duplicates. This subset was likely small enough to review in a timely manner.
It's 2016 folks. They didn't have to print out 650,000 emails and have humans sitting at desks with highlighters while they manually reviewed every email.
BTW - I am a Software Engineer that specializes in programming database searches, data comparisons and loads for huge volumes of data for large corporations. High speed processing of massive amounts of data is nothing these days. I can go through 5 billion rows of data in minutes with software tools that are commonly available. I can only imagine the software tools that are used by the FBI - likely top of the line.
I cannot imagine people think that agents combed through the emails one by one. I guess they forgot about computers.
650K emails is nothing for a computer. I'm constantly amazed at how many people are clueless about the power of modern technology.
I do all sorts of fancy technical things. When non-tech savvy people ask me "how did you do that", I just answer "We have computers now".
So, when I heard it couldn't be done the first thing I thought was "nonsense".
All that they need is a program to sort though the duplicates and it's done in no time. It's not at all hard.
Then today Snowden says exactly that.
Quote:
Drop non-responsive To:/CC:/BCC:, hash both sets, then subtract those that match. Old laptops could do it in minutes-to-hours.
Minutes to hours. I'm sure they had a few smart people at the FBI working on this. They even have new laptops.
A better question might be "Why did it take 9 days?"
I cannot imagine people think that agents combed through the emails one by one. I guess they forgot about computers.
They don't really think that, they are not stupid. But as they have learned from Trump - lies and exaggeration are never off the table, they are the primary strategy. Keep repeating the mantra - because there are plenty of empty headed people ready and willing to be taken in.
650K emails is nothing for a computer.
When I heard that it couldn't be done the first thing I thought was nonsense... all that they need is a program to sort though the duplicates and it's done in no time.
Then today Snowden says exactly that.
Minutes to hours. And they're not using old laptops.
Makes you wonder why the FBI didn't just do this first, before making an announcement, doesn't it? They would have known within a few days that there was no reason to say anything. But that wouldn't have given Comey his last opportunity to attempt to influence the election.
Low information voters strike again. Coding software is used in pretty much all high-level research these days to parse down large volumes of data into meaningful groupings, and analysts go from there. But since most Trumpers live in the mental Stone Age, they haven't moved beyond chisel-and-tablet.
Please register to post and access all features of our very popular forum. It is free and quick. Over $68,000 in prizes has already been given out to active posters on our forum. Additional giveaways are planned.
Detailed information about all U.S. cities, counties, and zip codes on our site: City-data.com.
Please register to participate in our discussions with 2 million other members - it's free and quick! Some forums can only be seen by registered members. After you create your account, you'll be able to customize options and access all our 15,000 new posts/day with fewer ads.
They would have known within a few days that there was no reason to say anything. But that wouldn't have given Comey his last opportunity to attempt to influence the election.
