testing

New Issue

high start up cost with high -count and no testsNeedsDecisionPerformance

#49050 opened 6 days ago by prattmic

test_fuzz_mutator_repeat failures with "inputs are not equal" NeedsInvestigationfuzzrelease-blocker

#49047 opened 6 days ago by bcmills

apparent deadlock in test_fuzz_fuzztimeNeedsInvestigationTestingfuzzrelease-blocker

#49046 opened 6 days ago by bcmills

fuzz funcs that panic print redundant stack framesNeedsInvestigationfuzz

#48885 opened 2 weeks ago by mvdan

fuzzing results include duplicate outputWaitingForInfofuzz

#48884 opened 2 weeks ago by mvdan

minimization takes longer than expected for very large []byte/stringNeedsFixfuzz

#48820 opened 2 weeks ago by katiehockman

custom mutator support for fuzzingNeedsInvestigationfuzz

#48815 opened 2 weeks ago by s3nt3

unclear what t.Skip does in the context of fuzzingNeedsDecisionfuzz

#48779 opened 2 weeks ago by mvdan

a less error-prone API for benchmark iterationProposal

#48768 opened 2 weeks ago by bcmills

document file format for fuzz corpus filesDocumentationNeedsInvestigationfuzz

#48717 opened 3 weeks ago by rogpeppe

fuzzed function can corrupt internal state of fuzzerFeatureRequestNeedsDecisionfuzz

#48606 opened 1 month ago by stevenjohnstone

improve detection and reporting of deadlocks during fuzzingNeedsInvestigationfuzz

#48591 opened 1 month ago by bcmills

reject calls to Run within Cleanup callbacksNeedsFixhelp wanted

#48515 opened 1 month ago by bcmills

misleading error message when a parallel Cleanup function calls runtime.GoexitNeedsInvestigation

#48502 opened 1 month ago by bcmills

minimized crasher is unrelated to originalNeedsInvestigationfuzz

#48326 opened 1 month ago by stevenjohnstone

report line number for F.Add call with mismatched typeNeedsFixfuzz

#48302 opened 1 month ago by jayconrod

use T.Skip to mark a fuzz input as uninterestingFeatureRequestNeedsInvestigationfuzz

#48299 opened 1 month ago by jayconrod

successive integer and boolean mutations can be the sameNeedsInvestigationfuzz

#48291 opened 1 month ago by stevenjohnstone

cover profile indicates zero coverage of function under testNeedsFixfuzzrelease-blocker

#48178 opened 1 month ago by stevenjohnstone

would be useful to record fuzz crashers which cause OOM killsNeedsInvestigationfuzz

#47572 opened 2 months ago by stevenjohnstone

support subtests in fuzzerNeedsDecisionfuzz

#47413 opened 3 months ago by AlekSi

fuzz tests not discovered unless package path specified or GOMAXPROCS=1NeedsInvestigationfuzz

#47136 opened 3 months ago by kokes

failure messages should be easier to findNeedsInvestigation

#47080 opened 3 months ago by rogpeppe

provide a way to work around "race: limit on 8128 simultaneously alive goroutines is exceeded" errorNeedsInvestigation

#47056 opened 3 months ago by rogpeppe

colorize output on failing testsFeatureRequestNeedsInvestigation

#46921 opened 4 months ago by wymli

sub fuzz targetsFeatureRequestWaitingForInfofuzz

#46780 opened 4 months ago by srikrsna

visualize fuzz corpus coverageFeatureRequestNeedsInvestigationfuzz

#46765 opened 4 months ago by rolandshoemaker

support custom dictionaries in fuzzerFeatureRequestNeedsInvestigationfuzz

#46508 opened 4 months ago by rolandshoemaker

possible fuzzing strategiesNeedsInvestigationfuzz

#46507 opened 4 months ago by rolandshoemaker

Ambiguous error message for wrong `-benchtime` valueGoCommandNeedsFix

#46043 opened 5 months ago by umi0410

fuzz inputs that return interesting outputs should continue to be fuzzedNeedsInvestigationfuzz

#45761 opened 6 months ago by rolandshoemaker

consider having timeouts in test binaries be recoverable/handledProposal

#44929 opened 7 months ago by dprotaso

dependencies in init functions are not recorded in the 'go test' cache keyGoCommandNeedsInvestigation

#44625 opened 8 months ago by aronatkins

add fuzz test supportProposalProposal-AcceptedProposal-FinalCommentPeriodfuzz

#44551 opened 8 months ago by katiehockman

clarify when TestMain is appropriate and notDocumentationNeedsInvestigation

#44200 opened 8 months ago by matttproud

benchmark unit propertiesProposalProposal-AcceptedProposal-FinalCommentPeriod

#43744 opened 9 months ago by aclements

add Elapsed() method to testing.BProposal

#43620 opened 9 months ago by mmcloughlin

document that directories returned by TB.TempDir should not be accessed after cleanupDocumentationNeedsFixhelp wanted

#43547 opened 9 months ago by howardjohn

relax lower-case suffix requirement for example test annotationProposal

#43528 opened 9 months ago by kortschak

don't overwrite race detector exit codeNeedsInvestigation

#43001 opened 10 months ago by hansbogert

document -test.benchmem and ReportAllocs output formatDocumentationNeedsFixhelp wanted

#42239 opened 1 year ago by ianlancetaylor

show diffs for incorrect output from Example testsProposalProposal-AcceptedProposal-FinalCommentPeriod

#41980 opened 1 year ago by komuw

run Cleanup if SIGINT occursNeedsInvestigation

#41891 opened 1 year ago by katiehockman

Provide `TestMain` with stats so that it can print a custom summary.Proposal

#41878 opened 1 year ago by michael-schaller

document rules for using TBDocumentationNeedsInvestigationhelp wanted

#41269 opened 1 year ago by dsymonds

test failes if leaving files without write permission in T.TempDirNeedsInvestigation

#40853 opened 1 year ago by atetubou

Document that T.Log and friends should not be invoked after the end of the test DocumentationNeedsInvestigationhelp wanted

#40343 opened 1 year ago by slinkydeveloper

Add LogWriter() method to testing.T for usage with log.LoggerProposal

#39519 opened 1 year ago by nhooyr

log the names of running tests when a timeout occursProposal

#39038 opened 1 year ago by bcmills

reuse the iteration number of the first round when count > 1Proposal

#38000 opened 2 years ago by shawn-xdji

calculate 'grain' in different way if specifying -benchtime=NxProposal

#37996 opened 2 years ago by shawn-xdji

optionally include full (or relative) path nameNeedsInvestigation

#37708 opened 2 years ago by stapelberg

Docs unclear what Cleanup does when called in a subtest.DocumentationNeedsInvestigation

#37333 opened 2 years ago by brackendawson

go test JSON output reports failure if stdout redirectedNeedsInvestigation

#37304 opened 2 years ago by james-johnston-thumbtack

when using a custom TestMain, m.Run does not return if one of the tests it runs panicsNeedsInvestigation

#37206 opened 2 years ago by orlangure

testing Log functions do not capture timestampNeedsInvestigation

#36656 opened 2 years ago by vimalk78

no way to properly distribute non-trivial runnable examplesNeedsInvestigation

#36586 opened 2 years ago by mvdan

reconsider adding Context method to testing.TProposal

#36532 opened 2 years ago by rogpeppe

the overview documentation on (*T) Run is unclearDocumentationNeedsInvestigation

#35824 opened 2 years ago by opennota

t.Parallel in a subtest masks races with the outer test functionNeedsInvestigation

#35670 opened 2 years ago by bcmills

better information about debugging test cache failuresNeedsInvestigationhelp wanted

#35301 opened 2 years ago by kevinburke

using "go tool test2json dlv test-binary" marks the last test as failed on Mac OS NeedsInvestigation

#34286 opened 2 years ago by nd

writing to os.Stderr pollutes test names in `go test -json` outputNeedsInvestigationhelp wanted

#33419 opened 2 years ago by liggitt

Benchmark prints nothing on failureNeedsInvestigation

#32066 opened 2 years ago by rogpeppe

parallel benchmark results are poorly documentedDocumentationNeedsFix

#31884 opened 2 years ago by aclements

Inconsistent benchmark data when GOMAXPROCS=1NeedsInvestigation

#31599 opened 2 years ago by xuanjiazhen

support explicitly running non-hermetic (or non-deterministic) examplesNeedsInvestigation

#31310 opened 2 years ago by mvdan

exclude unreachable code in test coverageFeatureRequestNeedsDecision

#31280 opened 2 years ago by santhosh-tekuri

benchmark is using low resolution time on WindowsNeedsInvestigationPerformanceTesting

#31160 opened 2 years ago by egonelbre

benchmark performance misaligned for fast testsNeedsInvestigationTesting

#30928 opened 2 years ago by kokes

loses log messages made in a goroutine after test has completedNeedsFix

#30389 opened 2 years ago by ianlancetaylor

move gomaxprocs to key-value pair in benchmark outputNeedsFixearly-in-cycle

#30056 opened 2 years ago by rsc

Benchmark calls during benchmarks deadlockNeedsFix

#29727 opened 2 years ago by empijei

Logf not reported outside of inner benchmark runNeedsInvestigation

#29211 opened 2 years ago by griesemer

t.FailNow() in a deferred function masks test panicNeedsInvestigation

#29207 opened 2 years ago by matthewmcnew

test output interleaves with race-detector warningsNeedsInvestigation

#29156 opened 2 years ago by mfridman

Benchmark reporting incorrect stats when running in parallelNeedsInvestigation

#28813 opened 2 years ago by mnewswanger

document that tests should not write to their working directoryDocumentationNeedsInvestigation

#28386 opened 3 years ago by bcmills

No way to view untruncated output from benchmarksNeedsDecision

#27901 opened 3 years ago by Minnozz

testing a list of packages blocks the real-time outputNeedsInvestigationTesting

#27826 opened 3 years ago by mwf

document best practices for avoiding compiler optimizations in benchmarksDocumentationNeedsInvestigationhelp wanted

#27400 opened 3 years ago by nicksnyder

tiny benchmark with StopTimer runs foreverNeedsInvestigation

#27217 opened 3 years ago by peterGo

examples with trailing whitespace in multiple lines of output can be confusingNeedsInvestigation

#26460 opened 3 years ago by joesis

parallel test output reported in non-deterministic orderNeedsInvestigation

#26440 opened 3 years ago by rsc

stdout output with no newline produces confusing/corrupt -v outputNeedsInvestigation

#26325 opened 3 years ago by neild

add a flag to detect unnecessary skipsProposalProposal-Hold

#25951 opened 3 years ago by bcmills

mention the “_test” package idiomDocumentationNeedsFix

#25223 opened 3 years ago by bcmills

show rusage statistics for benchmarksNeedsInvestigation

#24905 opened 3 years ago by LMMilewski

start test log for caching before TestMainNeedsDecision

#24122 opened 3 years ago by bakatz

test with child process sometimes hangs on 1.10; -timeout not respectedNeedsInvestigation

#24050 opened 3 years ago by psanford

only find the target b.N once when -count > 1NeedsFixhelp wanted

#23423 opened 3 years ago by cespare

update documentation to be clear about when parallel subtests runDocumentationNeedsFixhelp wanted

#23368 opened 3 years ago by zwass

Helper's highest function call's information should be maintained for any subsequent/nested callsNeedsFixhelp wanted

#23249 opened 3 years ago by mattcary

collect performance counters for benchmarksProposalProposal-Accepted

#21295 opened 4 years ago by cherrymui

allow examples to return an errorProposalProposal-Hold

#21111 opened 4 years ago by rogpeppe

consider calling ReadMemStats less during benchmarkingNeedsFixPerformance

#20875 opened 4 years ago by josharian

output hard to read when a test case is stallingNeedsInvestigationhelp wanted

#19397 opened 4 years ago by rakyll

add -benchsplit to get more data pointsFeatureRequestNeedsFixProposalProposal-Acceptedhelp wanted

#19128 opened 4 years ago by bcmills

align package duration values

#15944 opened 5 years ago by mdwhatcott

complain loudly during concurrent use of T.FatalX and T.SkipXNeedsFixhelp wanted

#15758 opened 5 years ago by dsnet

autodetect appropriate benchtime

#10930 opened 6 years ago by josharian

show more benchmark data

#10669 opened 6 years ago by rsc

measure coverage inside boolean expressionshelp wanted

#8741 opened 7 years ago by josharian

add ratcheting variants

#7465 opened 7 years ago by josharian

add test helpers for measuring goroutine leaks

#6705 opened 8 years ago by bradfitz