Email Subscription Form

Saturday, May 30, 2020

Book Review: Perfect Software and Other Illusions About Testing

"Perfect Software and Other Illusions About Testing", by Gerald Weinberg, is the best book on testing I have ever read.  It is a must-read for anyone who works with software: CEOs, CTOs, scrum masters, team leads, developers, product owners, business analysts, and software testers.

Before I get into why this book is so great, I'll first acquaint you with the author.  Gerald "Jerry" Weinberg (1933-2018) was involved in the creation of software for over fifty years.  Early in his career he worked for NASA on Project Mercury, the project that created spacecraft that allowed a human to orbit the earth.  For decades he consulted with companies about building quality software, and over those years he gained a great deal of wisdom about software testing.  "Perfect Software", which was published in 2014, seems to me to be the culmination of his years of experience.


The book is divided into several chapters, each of which looks at a particular aspect of software testing. Many examples are given from Jerry's consulting experience, and each chapter closes with a summary and a list of common mistakes that companies make.  Rather than summarizing the lessons he imparts, I think it would be best to include Jerry's own words here.  Here are some of my favorite quotes from the book:

"Before you even begin to test, ask yourself: What questions do I have about this product's risks?  Will testing help answer these questions?"

"There are an infinite number of possible tests...Since we can't test everything, any set of real tests is some kind of sample- a portion, piece, or segment that is in some way representative of a whole set of possible tests."

"Knowing about the structure of the software you're testing can help you to identify special cases, subtle features, and important ranges to try- all of which can help narrow the inference gap between what the software can do and what it will do during actual use."

"Testing gathers information about a product; it does not fix things it finds that are wrong."

"If you're going to ignore information or go ahead with predetermined plans despite what the tests turn up, don't bother testing."

"If you blame messengers for bringing news you don't want to hear, you'll be rewarded by not hearing the news you should hear."

"Quality is a product of the entire development process.  Poor testing can lead to poor quality, but good testing won't lead to good quality unless all other parts of the process are in place and performed properly."

"Testing starts at project conception, or before. If you don't know this, you don't understand testing at all."

"Without a process that includes regular technical reviews, no project will rise above mediocrity, no matter how good its machine-testing process."

"No developer is good enough to consistently do it alone, and do it right."

"Data are meaningless until someone determines their meaning.  Different people give different meanings to the same data.  Gather data, then sit down and ponder at least three possible meanings."

"When someone says, 'The response should be very fast', what does that mean, exactly?  What meanings do 'should', 'very', and 'fast' give to the stated information?"

"Numbers can be useful, but only if they're validated by personal observation and set in context by a story about them."

"Garbage arranged in a spreadsheet is still garbage."

Jerry uses many great hypothetical scenarios to illustrate his points, and he also uses real-world examples from his years of consulting.  Here are some of my favorites:

  • The tester who didn't log a bug he found because it wasn't in "his" component
  • The manager who thought that the project was ready to ship because they ran 600,000 test cases and "nothing crashed the system"
  • The team who thought their biggest problem was their bug-tracking system, because the system couldn't handle their 140,000 open bugs
  • The team who took so long to triage bugs that couldn't make a decision on any of them, resulting in 129 undiscussed and unfixed bugs
  • The tester who assumed that her new automated test tool was working correctly because all the tests displayed in green at the end
  • The developer-tester team who were gaming the bug bounty system by having the developer add bugs to the code, the tester find the bugs quickly, and the developer fix them just as quickly, resulting in rewards for both
  • The VP of Development who wanted a really big written test plan so he could have something big to slam down on a desk to "prove" that they had tested well

If you would like to think about what role testing plays in your software development project, what constitutes a good test, how to plan testing for a project, or how to interpret test data in order to make management decisions, then "Perfect Software" is the book for you.  I plan to re-read this book every year to make sure that I have fully retained all the lessons it offers.

38 comments:

  1. Great book. I need to get it back out again.

    ReplyDelete
    Replies





    1. Hello World
      I’m hacker and Services provider
      interested in any thing i do fair deals.
      I will show you each and everything to start business
      also teaching Hacking / spamming short courses
      I have all tools that you need to spam

      .. Western Union transfer
      .. Credit cards
      .. Money adders
      .. Bill paying
      .. College fee
      .. Fake documents
      .. Grade change

      Contact:

      omoskovitz@gmail.com


      Delete
    2. I highly recommend a particular trader to everyone looking for forex, crypto and Binary trader. In this period of economic crisis, Instead of going for a loan I decided to invest in Forex/bitcoins trading with Barry Silbert, After reading a lot of good reviews about him . I am glad to tell you that he is the only legit trader I know. I now make more than $6,099 a week. He can help you earn formidable profit weekly  with his good trading strategies weekly, For more details, Contact Mr Barry Silbert on Email: Barrysilbert540@gmail .com  
      WhatsApp: +447508298691  

      Delete
  2. Hey Guys !

    USA Fresh & Verified SSN Leads with DL Number AVAILABLE with 99.9% connectivity
    All Leads have genuine & valid information

    **HEADERS IN LEADS**
    First Name | Last Name | SSN | Dob | DL Number | Address | City | State | Zip | Phone Number | Account Number | Bank Name | Employee Details | IP Address

    *Price for SSN lead $2
    *You can ask for sample before any deal
    *If anyone buy in bulk, we can negotiate
    *Sampling is just for serious buyers

    ==>ACTIVE, FRESH CC & CVV FULLZ AVAILABLE<==
    ->$5 PER EACH

    ->Hope for the long term deal
    ->Interested buyers will be welcome

    **Contact 24/7**
    Whatsapp > +923172721122
    Email > leads.sellers1212@gmail.com
    Telegram > @leadsupplier
    ICQ > 752822040

    ReplyDelete
  3. Very interesting, Wish to see much more like this. Thanks for sharing your information!
    Web Application Development

    ReplyDelete
  4. This comment has been removed by the author.

    ReplyDelete
  5. With pandemic, the importance of short courses in rawalpindi has been increased rapidly as most of the people are losing jobs, which has gradually increased the rate of unemployment in Pakistan. This is why it is a need of time for the youth and professionals to be skillful, so they can start earning along with job or work. This will give them financial stability in a hard time.

    ReplyDelete
  6. Perfect Software--And Other Illusions about Testing is simple in our digital library an online entry to it is set as public hence you can download it instantly. for more information click here: Hoarding Advertising

    ReplyDelete
  7. Hello everyone, Are you into trading or just wish to give it a try, please becareful on the platform you choose to invest on and the manager you choose to manage your account because that’s where failure starts from be wise. After reading so much comment i had to give trading tips a try, I have to come to the conclusion that binary options pays massively but the masses has refused to show us the right way to earn That’s why I have to give trading tips the accolades because they have been so helpful to traders . For a free masterclass strategy kindly contact (paytondyian699@gmail.com) for a free masterclass strategy. He'll give you a free tutors on how you can earn and recover your losses in trading for free..

    ReplyDelete
  8. Investing online has been a main source of income,that's why knowledge plays a very important role in humanity,you don't need to over work yourself for money.All you need is the right information,and you could build your own wealth from the comfort of your home!Binary trading is dependent on timely signals,assets or controlled strategies which when mastered increases chance of winning up to 90%-100% with trading. It’s possible to earn $10,000 to $20,000 trading weekly-monthly,just file a complaint with  Robert,I had almost given up on everything about binary trading and ever getting my lost funds back,till i met with him,with his help now i have my lost funds back to my bank account and I can now trade successfully with his profitable strategies and software!! Email: Robertseaman939@gmail.com or  whatsApp: +44 7466 770724

    ReplyDelete
  9. BE SMART AND BECOME RICH IN LESS THAN 3DAYS....It all depends on how fast 
    you can be to get the new PROGRAMMED blank ATM card that is capable of
    hacking into any ATM machine,anywhere in the world. I got to know about 
    this BLANK ATM CARD when I was searching for job online about a month 
    ago..It has really changed my life for good and now I can say I'm rich and 
    I can never be poor again. The least money I get in a day with it is about 
    $50,000.(fifty thousand USD) Every now and then I keeping pumping money 
    into my account. Though is illegal,there is no risk of being caught 
    ,because it has been programmed in such a way that it is not traceable,it 
    also has a technique that makes it impossible for the CCTVs to detect 
    you..For details on how to get yours today, email the hackers on : (
    atmmachinehackers1@gmail.com ). Tell your 
    loved once too, and start to live large. That's the simple testimony of how 
    my life changed for good...Love you all ...the email address again is ;
    atmmachinehackers1@gmail.com

    ReplyDelete
  10. Hi Guy's

    Fresh & valid spammed USA SSN+Dob Leads with DL available in bulk.

    >>1$ each SSN+DOB
    >>2$ each with SSN+DOB+DL
    >>5$ each for premium (also included relative info)

    Prices are negotiable in bulk order
    Serious buyer contact me no time wasters please
    Bulk order will be preferable

    CONTACT
    Telegram > @leadsupplier
    ICQ > 752822040
    Email > leads.sellers1212@gmail.com

    OTHER STUFF YOU CAN GET

    SSN+DOB Fullz
    CC's with CVV's (vbv & non-vbv)
    USA Photo ID'S (Front & back)

    All type of tutorials available
    (Carding, spamming, hacking, scam page, Cash outs, dumps cash outs)

    SMTP Linux Root
    DUMPS with pins track 1 and 2
    Socks, rdp's, vpn's
    Server I.P's
    HQ Emails with passwords

    Looking for long term business
    For trust full vendor, feel free to contact

    CONTACT
    Telegram > @leadsupplier
    ICQ > 752822040
    Email > leads.sellers1212@gmail.com

    ReplyDelete
  11. In this era we are surrounded by different technological amenities with all businesses having an online presence, you need secure and trustworthy cybersecurity solutions to keep it safe from any potential security threat.

    Breeze End Technology, LLC offer reliable and top-notch cybersecurity to help organizations fight cyber risks. We cover all aspects of cybersecurity to provide you with a complete range of services as our team is constantly on the verge of the latest advancements.

    We work with a comprehensive approach to keep your business safe from cyber threats. From cybersecurity program strategy to risk assessment, threat intelligence to security monitoring services, we have got a complete package for you. Our highly qualified and competent team knows how to fill in cybersecurity gaps to provide a clear road map for a powerful and strong cybersecurity system.

    Empowering you by Reliable Cyber Security Solutions, Email Security Services, Alert Logic Log Manager, Managed Data Security Offerings, Onsite & Remote Internet Security Services, Threat Manager with ActiveWatch, Web Security Manager: Trust the Security Experts, Website & Web Application Protection

    ReplyDelete
  12. Awesome post, thanks for writing thus article. Mobile App Testing Services

    ReplyDelete
  13. I blog quite often and I truly appreciate your information.
    The article has really peaked my interest. I will bookmark your site and
    keep checking for new information about once a week.
    social media marketing
    digital marketing

    ReplyDelete
  14. Do you Need Instant Loan from $2,000 to $50,000,000.00 with no collateral required and receive a no obligation loan approval.We welcome the opportunity to show you how effective we are at helping our clients obtain the money they need to succeed. Our professional staff is available for a Free Consultation.At Patiala legitimate company Pvt , contact us now 2% interest rate, both long and short term cash reply to us (Whats App) number: +919394133968 patialalegitimate515@gmail.com 
    Mr Jeffery

    ReplyDelete
  15. A technical specification for an automotive sector quality management system published by a group of automotive industries called International Automotive Task Force (IATF) to provide improved quality products to its customers worldwide. Visit iatf 16949 netherlands

    ReplyDelete
  16. Buy Shop Bath Accessories Online in Pakistan.Buy Bathroom accessories set online in Karachi Get Bath Accessories Online in Karachi, Lahore, Islamabad & All Across Pakistan.

    ReplyDelete
  17. ISO 27001:2013 is an international standard for an Information Security Management System (ISMS), globally recognized ISO 27000 family of standards. Visit iso 27001 certification

    ReplyDelete
  18. This comment has been removed by the author.

    ReplyDelete
  19. **FULLZ WITH HIGH CREDIT SCORES AVAILABLE**
    **HACKING TOOLS WITH TUTORIALS AVAILABLE**
    (High Quality, Genuine Seller)

    =>Contact 24/7<=
    Telegram> @killhacks
    ICQ> 752822040
    Skype> Peeterhacks

    Fullz info included
    NAME+SSN+DOB+DL+DL-STATE+ADDRESS
    Employee & Bank details included
    High credit fullz with DL 700+
    (bulk order negotiable)
    **Payment in all crypto currencies will be accepted**

    ->You can buy few for testing
    ->Invalid or wrong info will be replaced
    ->Serious buyers needed for long term

    TOOLS & TUTORIALS AVAILABLE:

    "SPAMMING" "HACKING" "CARDING" "CASH OUT"
    "KALI LINUX" "BLOCKCHAIN BLUE PRINTS"

    **TOOLS & TUTORIALS LIST**

    ->US CC Fullz
    ->Ethical Hacking Tools & Tutorials
    ->Kali Linux
    ->Keylogger & Keystroke Logger
    ->Facebook & Google Hacking
    ->Bitcoin Flasher
    ->SQL Injector
    ->Paypal Logins/Amazon Logins/Coinbase Logins
    ->Bitcoin Cracker
    ->SMTP Linux Root
    ->Shell Scripting
    ->DUMPS with pins track 1 and 2 with and without pin
    ->SMTP's, Safe Socks, Rdp's brute
    ->Php mailer
    ->SMS Sender & Email Blaster
    ->Cpanel
    ->Server I.P's & Proxies
    ->Viruses & VPN's
    ->Premium Accounts (netflix cracker, paypal logins, pornhub, amazon)
    ->HQ Email Combo

    If you are searching for a valid vendor, I'm here for you.
    You'll never be disappointed.
    **You should try at least once**

    Contact 24/7
    Telegram> @killhacks
    ICQ> 752822040
    Skype> Peeterhacks

    ReplyDelete
  20. Can Titanium Rings be Resized? - The ITIAN ART
    For the sake of clarity, we have the option of tittanium making titanium quartz meaning these materials in titanium rings titanium tent stove as long as titanium necklace mens you have 2019 ford fusion hybrid titanium a high quality graphite.

    ReplyDelete
  21. This is a great inspiring article. I'm pretty much pleased with your good work. You put really very helpful information. Keep it up. Keep blogging. Looking forward to reading your next post and visit us if you want to know about online shop for flowers.

    ReplyDelete
  22. You plan to read this book every year to make sure that. You have fully retained all the lessons it offers. Thanks for sharing this article. Now it's time to avail HALFCASTE CREAM SET for more information.

    ReplyDelete
  23. Great post i must say and thanks for the information. Education is definitely a sticky subject. However,
    is still among the leading topics of our time. I appreciate your post and look forward to more.SEO Firm Chicago

    ReplyDelete
  24. What's Up Everyone

    Fresh Databases available

    CC's CVV's SSN
    Pros High Credit Scores 700+
    Fullz/Leads with SSN+DOB+DL
    Dumps
    EIN Leads
    Bulk HQ Emails
    Office365 Emails & Logs

    >>>WA/Telegram +92 317 272 1122
    >>>ICQ 752822040
    >>>Skype/Wickr @peeterhacks
    >>>Email exploit dot tools4u at gmail dot com

    Quality Tools & Tutorials available for
    HACKING|SPAMMING|CARDING|SPYING|CLONING|CASH-OUTS|TRANSFERS

    Legit Fullz/Pros/Leads will be provided
    Bulk quantity also
    Invalid stuff will be replaced/No refund
    BTC & USDT payments mode
    Available 24/7

    Feel Free to contact Guy's

    ReplyDelete
  25. A wall Display Cabinet is an invaluable addition to any home. The decorative item can hold anything from your prized china set, old family photos, or the favorite books of a lifetime. There are many types and sizes available for purchase so it's easy to find one that will suit the needs of your home décor.

    ReplyDelete
  26. When it comes to your Custom Home Accents, one of the most important things you can do is give it a personal touch. The right mix of furnishings and decor can transform any space into something truly special. With Grayson Home, finding that perfect addition has never been easier!

    ReplyDelete
  27. Looking to buy Adobe Products Online ? Discover a wide range of Adobe software, including Photoshop, Illustrator, InDesign, and more. Get the best deals and discounts on Adobe products online, and unleash your creativity today!

    ReplyDelete

  28. Unleash your creativity this Cyber Week and Black Friday with a spectacular offer from SketchUp Pro! Dive into the world of 3D design and modeling at an unbeatable price. Discover the Design Freedom at Your Fingertips: Navigating Sketchup software price in India for Every Budget! and also pricing details and options tailored for users in India. Act fast – this exclusive offer is valid only from November 20 to November 24, 2023. Elevate your design journey with SketchUp Pro today!

    ReplyDelete
  29. Great article thank you for sharing the valuable information.
    Best Software Testing Services.

    ReplyDelete
  30. boost the confidence of people and build trust among potential customers affiliate platform frequently called Amazon Associates, stands proud as a rewarding option.

    ReplyDelete

  31. Columbia Garage Door Repair offers reliable solutions for all your garage door needs. With years of experience, our team specializes in repairing, installing, and maintaining garage doors of all makes and models. Whether it's a broken spring, malfunctioning opener, or damaged panel, we provide efficient and cost-effective repairs to get your garage door working smoothly again.

    Our skilled technicians prioritize customer satisfaction, ensuring prompt service and lasting results. We also offer preventive maintenance plans to keep your garage door functioning optimally. Trust Columbia garage door repair for professional service, quality craftsmanship, and peace of mind for your home or business.

    ReplyDelete