testing

New Issue

Listing the topN most time-consuming test cases as the last outputProposal

#54198 opened 2 weeks ago by bo-er

benchmark output should include settings like GOAMD64FeatureRequestNeedsInvestigation

#53782 opened 1 month ago by mvdan

add support for individual test function execution - expose testing.M.TestsProposalProposal-FinalCommentPeriod

#53701 opened 1 month ago by mattdbush

coverprofile can't profile coverage of test cases themselvesNeedsInvestigation

#53508 opened 1 month ago by seebs

add Name to track file and line of test case declarationProposal

#52751 opened 3 months ago by dsnet

fuzzer aborts with "fuzzing process hung or terminated unexpectedly while minimizing: EOF"NeedsInvestigation

#52569 opened 3 months ago by lmb

report GC/op when b.ReportAllocs is calledProposalProposal-AcceptedProposal-FinalCommentPeriod

#52466 opened 3 months ago by mknyszek

respect -count when running fuzz corpus testsNeedsInvestigation

#52464 opened 3 months ago by elias-orijtech

Whether to support printing random corpus in the futureNeedsInvestigation

#51745 opened 5 months ago by gcggcg

Fuzzer reports 0 execs/sec and keeps runningNeedsInvestigationfuzz

#51484 opened 5 months ago by capnspacehook

normalize line endings in output comparisonsNeedsInvestigation

#51269 opened 6 months ago by benhoyt

link to fuzzing guide and more details on runtimeDocumentationNeedsFixfuzz

#51032 opened 6 months ago by ronaldpetty

add an example showcasing B.RunParallel with B.ReportMetricDocumentationNeedsFixSuggested

#50756 opened 6 months ago by mvdan

`gotip test -fuzz='^FuzzName$'` appears to run regular tests as wellNeedsInvestigationfuzz

#50432 opened 7 months ago by dnwe

run first benchmark with last value from -cpu list GOMAXPROCS valueNeedsInvestigation

#49980 opened 8 months ago by KochankovID

benchmark timeout when benchtime set too longNeedsInvestigation

#49973 opened 8 months ago by lkxiaolou

t.Failed() returns false during panicNeedsFix

#49929 opened 8 months ago by gbuenoandrade

fuzz funcs that panic print redundant stack framesNeedsInvestigationfuzz

#48885 opened 10 months ago by mvdan

minimization takes longer than expected for very large []byte/stringNeedsFixfuzz

#48820 opened 10 months ago by katiehockman

custom mutator support for fuzzingFeatureRequestNeedsInvestigationfuzz

#48815 opened 10 months ago by s3nt3

unclear what t.Skip does in the context of fuzzingNeedsDecisionfuzz

#48779 opened 10 months ago by mvdan

a less error-prone API for benchmark iterationProposalProposal-Hold

#48768 opened 10 months ago by bcmills

fuzzed function can corrupt internal state of fuzzerFeatureRequestNeedsDecisionfuzz

#48606 opened 10 months ago by stevenjohnstone

reject calls to Run within Cleanup callbacksNeedsFixhelp wanted

#48515 opened 11 months ago by bcmills

misleading error message when a parallel Cleanup function calls runtime.GoexitNeedsInvestigation

#48502 opened 11 months ago by bcmills

minimized crasher is unrelated to originalNeedsInvestigationfuzz

#48326 opened 11 months ago by stevenjohnstone

report line number for F.Add call with mismatched typeNeedsFixfuzz

#48302 opened 11 months ago by jayconrod

successive integer and boolean mutations can be the sameNeedsInvestigationfuzz

#48291 opened 11 months ago by stevenjohnstone

would be useful to record fuzz crashers which cause OOM killsNeedsInvestigationfuzz

#47572 opened 1 year ago by stevenjohnstone

support subtests in fuzzerNeedsDecisionfuzz

#47413 opened 1 year ago by AlekSi

fuzz tests not discovered unless package path specified or GOMAXPROCS=1NeedsInvestigationfuzz

#47136 opened 1 year ago by kokes

failure messages should be easier to findNeedsInvestigation

#47080 opened 1 year ago by rogpeppe

colorize output on failing testsFeatureRequestNeedsInvestigation

#46921 opened 1 year ago by wymli

sub fuzz targetsFeatureRequestNeedsDecisionfuzz

#46780 opened 1 year ago by srikrsna

visualize fuzz corpus coverageFeatureRequestNeedsInvestigationfuzz

#46765 opened 1 year ago by rolandshoemaker

support custom dictionaries in fuzzerFeatureRequestNeedsInvestigationfuzz

#46508 opened 1 year ago by rolandshoemaker

possible fuzzing strategiesNeedsInvestigationfuzz

#46507 opened 1 year ago by rolandshoemaker

Ambiguous error message for wrong `-benchtime` valueGoCommandNeedsFix

#46043 opened 1 year ago by umi0410

fuzz inputs that return interesting outputs should continue to be fuzzedNeedsInvestigationfuzz

#45761 opened 1 year ago by rolandshoemaker

consider having timeouts in test binaries be recoverable/handledProposal

#44929 opened 1 year ago by dprotaso

dependencies in init functions are not recorded in the 'go test' cache keyGoCommandNeedsInvestigation

#44625 opened 1 year ago by aronatkins

clarify when TestMain is appropriate and notDocumentationNeedsInvestigation

#44200 opened 2 years ago by matttproud

benchmark unit propertiesProposalProposal-AcceptedProposal-FinalCommentPeriod

#43744 opened 2 years ago by aclements

add Elapsed() method to testing.BProposalProposal-AcceptedProposal-FinalCommentPeriod

#43620 opened 2 years ago by mmcloughlin

document that directories returned by TB.TempDir should not be accessed after cleanupDocumentationNeedsFixhelp wanted

#43547 opened 2 years ago by howardjohn

relax lower-case suffix requirement for example test annotationProposal

#43528 opened 2 years ago by kortschak

don't overwrite race detector exit codeNeedsInvestigation

#43001 opened 2 years ago by hansbogert

document -test.benchmem and ReportAllocs output formatDocumentationNeedsFixhelp wanted

#42239 opened 2 years ago by ianlancetaylor

show diffs for incorrect output from Example testsProposalProposal-AcceptedProposal-FinalCommentPeriod

#41980 opened 2 years ago by komuw

run Cleanup if SIGINT occursNeedsInvestigation

#41891 opened 2 years ago by katiehockman

Provide `TestMain` with stats so that it can print a custom summary.Proposal

#41878 opened 2 years ago by michael-schaller

document rules for using TBDocumentationNeedsInvestigationhelp wanted

#41269 opened 2 years ago by dsymonds

test failes if leaving files without write permission in T.TempDirNeedsInvestigation

#40853 opened 2 years ago by atetubou

Document that T.Log and friends should not be invoked after the end of the test DocumentationNeedsInvestigationhelp wanted

#40343 opened 2 years ago by slinkydeveloper

Add LogWriter() method to testing.T for usage with log.LoggerProposal

#39519 opened 2 years ago by nhooyr

log the names of running tests when a timeout occursProposal

#39038 opened 2 years ago by bcmills

reuse the iteration number of the first round when count > 1Proposal

#38000 opened 2 years ago by shawndx

calculate 'grain' in different way if specifying -benchtime=NxProposal

#37996 opened 2 years ago by shawndx

optionally include full (or relative) path nameNeedsInvestigation

#37708 opened 2 years ago by stapelberg

Docs unclear what Cleanup does when called in a subtest.DocumentationNeedsInvestigation

#37333 opened 2 years ago by brackendawson

go test JSON output reports failure if stdout redirectedNeedsInvestigation

#37304 opened 2 years ago by james-johnston-thumbtack

when using a custom TestMain, m.Run does not return if one of the tests it runs panicsNeedsInvestigation

#37206 opened 2 years ago by orlangure

testing Log functions do not capture timestampNeedsInvestigation

#36656 opened 2 years ago by vimalk78

no way to properly distribute non-trivial runnable examplesNeedsInvestigation

#36586 opened 2 years ago by mvdan

reconsider adding Context method to testing.TProposal

#36532 opened 2 years ago by rogpeppe

the overview documentation on (*T) Run is unclearDocumentationNeedsInvestigation

#35824 opened 2 years ago by opennota

t.Parallel in a subtest masks races with the outer test functionNeedsInvestigation

#35670 opened 2 years ago by bcmills

better information about debugging test cache failuresNeedsInvestigationhelp wanted

#35301 opened 2 years ago by kevinburke

using "go tool test2json dlv test-binary" marks the last test as failed on Mac OS NeedsInvestigation

#34286 opened 2 years ago by nd

writing to os.Stderr pollutes test names in `go test -json` outputNeedsInvestigationhelp wanted

#33419 opened 3 years ago by liggitt

Benchmark prints nothing on failureNeedsInvestigation

#32066 opened 3 years ago by rogpeppe

parallel benchmark results are poorly documentedDocumentationNeedsFix

#31884 opened 3 years ago by aclements

Inconsistent benchmark data when GOMAXPROCS=1NeedsInvestigation

#31599 opened 3 years ago by xuanjiazhen

support explicitly running non-hermetic (or non-deterministic) examplesNeedsInvestigation

#31310 opened 3 years ago by mvdan

exclude unreachable code in test coverageFeatureRequestNeedsDecision

#31280 opened 3 years ago by santhosh-tekuri

benchmark is using low resolution time on WindowsNeedsInvestigationPerformanceTesting

#31160 opened 3 years ago by egonelbre

benchmark performance misaligned for fast testsNeedsInvestigationTesting

#30928 opened 3 years ago by kokes

loses log messages made in a goroutine after test has completedNeedsFix

#30389 opened 3 years ago by ianlancetaylor

move gomaxprocs to key-value pair in benchmark outputNeedsFixearly-in-cycle

#30056 opened 3 years ago by rsc

Benchmark calls during benchmarks deadlockNeedsFix

#29727 opened 3 years ago by empijei

Logf not reported outside of inner benchmark runNeedsInvestigation

#29211 opened 3 years ago by griesemer

t.FailNow() in a deferred function masks test panicNeedsInvestigation

#29207 opened 3 years ago by matthewmcnew

test output interleaves with race-detector warningsNeedsInvestigation

#29156 opened 3 years ago by mfridman

Benchmark reporting incorrect stats when running in parallelNeedsInvestigation

#28813 opened 3 years ago by mnewswanger

No way to view untruncated output from benchmarksNeedsDecision

#27901 opened 3 years ago by Minnozz

testing a list of packages blocks the real-time outputNeedsInvestigationTesting

#27826 opened 3 years ago by mwf

document best practices for avoiding compiler optimizations in benchmarksDocumentationNeedsInvestigationhelp wanted

#27400 opened 4 years ago by nicksnyder

tiny benchmark with StopTimer runs foreverNeedsInvestigation

#27217 opened 4 years ago by peterGo

examples with trailing whitespace in multiple lines of output can be confusingNeedsInvestigation

#26460 opened 4 years ago by joesis

parallel test output reported in non-deterministic orderNeedsInvestigation

#26440 opened 4 years ago by rsc

stdout output with no newline produces confusing/corrupt -v outputNeedsInvestigation

#26325 opened 4 years ago by neild

add a flag to detect unnecessary skipsProposalProposal-Hold

#25951 opened 4 years ago by bcmills

mention the “_test” package idiomDocumentationNeedsFix

#25223 opened 4 years ago by bcmills

show rusage statistics for benchmarksNeedsInvestigation

#24905 opened 4 years ago by LMMilewski

start test log for caching before TestMainNeedsDecision

#24122 opened 4 years ago by bakatz

test with child process sometimes hangs on 1.10; -timeout not respectedNeedsInvestigation

#24050 opened 4 years ago by psanford

only find the target b.N once when -count > 1NeedsFixhelp wanted

#23423 opened 4 years ago by cespare

update documentation to be clear about when parallel subtests runDocumentationNeedsFixhelp wanted

#23368 opened 4 years ago by zwass

Helper's highest function call's information should be maintained for any subsequent/nested callsNeedsFixhelp wanted

#23249 opened 4 years ago by mattcary

collect performance counters for benchmarksProposalProposal-Accepted

#21295 opened 5 years ago by cherrymui

allow examples to return an errorProposalProposal-Hold

#21111 opened 5 years ago by rogpeppe

consider calling ReadMemStats less during benchmarkingNeedsFixPerformance

#20875 opened 5 years ago by josharian

output hard to read when a test case is stallingNeedsInvestigationhelp wanted

#19397 opened 5 years ago by rakyll

add -benchsplit to get more data pointsFeatureRequestNeedsFixProposalProposal-Acceptedhelp wanted

#19128 opened 5 years ago by bcmills

align package duration values

#15944 opened 6 years ago by mdwhatcott

complain loudly during concurrent use of T.FatalX and T.SkipXNeedsFixhelp wanted

#15758 opened 6 years ago by dsnet

autodetect appropriate benchtime

#10930 opened 7 years ago by josharian

show more benchmark data

#10669 opened 7 years ago by rsc

measure coverage inside boolean expressionshelp wanted

#8741 opened 8 years ago by josharian

add ratcheting variants

#7465 opened 8 years ago by josharian

add test helpers for measuring goroutine leaks

#6705 opened 8 years ago by bradfitz