testing

New Issue

Sub-benchmark that returns testing.BenchResults struct; maybe testing.B.Execute?Proposal

#59300 opened 4 days ago by ayang64

per-subtest setup and cleanupProposal

#59291 opened 4 days ago by unkeep

Testable examples collapse `Output` newlines, making them impossible to passNeedsFixhelp wanted

#59191 opened 1 week ago by keilin-anz

data race is attributed to wrong test in -json formatting NeedsInvestigation

#58634 opened 1 month ago by vearutop

calling `t.Helper()` in a goroutine logs asm file names, not the one from the call siteNeedsInvestigationcompiler/runtime

#58545 opened 1 month ago by pmalek

output timing and outcome of TestMain or possible setup and teardown functionsProposal

#57326 opened 3 months ago by doron-cohen

document how to export unexported identifiers in *_test.go DocumentationNeedsInvestigation

#56995 opened 4 months ago by changkun

fuzz reports spurious "process hung or terminated unexpectedly" errorsNeedsFix

#56238 opened 5 months ago by rsc

Listing the topN most time-consuming test cases as the last outputProposal

#54198 opened 8 months ago by bo-er

benchmark output should include settings like GOAMD64FeatureRequestNeedsInvestigation

#53782 opened 8 months ago by mvdan

coverprofile can't profile coverage of test cases themselvesNeedsInvestigation

#53508 opened 9 months ago by seebs

add Name to track file and line of test case declarationProposal

#52751 opened 11 months ago by dsnet

fuzzer aborts with "fuzzing process hung or terminated unexpectedly while minimizing: EOF"NeedsInvestigation

#52569 opened 11 months ago by lmb

report GC/op when b.ReportAllocs is calledProposalProposal-AcceptedProposal-FinalCommentPeriod

#52466 opened 11 months ago by mknyszek

respect -count when running fuzz corpus testsNeedsInvestigation

#52464 opened 11 months ago by elias-orijtech

Whether to support printing random corpus in the futureNeedsInvestigation

#51745 opened 1 year ago by gcggcg

Fuzzer reports 0 execs/sec and keeps runningNeedsInvestigationfuzz

#51484 opened 1 year ago by capnspacehook

normalize line endings in output comparisonsNeedsInvestigation

#51269 opened 1 year ago by benhoyt

link to fuzzing guide and more details on runtimeDocumentationNeedsFixfuzz

#51032 opened 1 year ago by ronaldpetty

`gotip test -fuzz='^FuzzName$'` appears to run regular tests as wellNeedsInvestigationfuzz

#50432 opened 1 year ago by dnwe

run first benchmark with last value from -cpu list GOMAXPROCS valueNeedsInvestigation

#49980 opened 1 year ago by KochankovID

benchmark timeout when benchtime set too longNeedsInvestigation

#49973 opened 1 year ago by lkxiaolou

t.Failed() returns false during panicNeedsFix

#49929 opened 1 year ago by gbuenoandrade

fuzz funcs that panic print redundant stack framesNeedsInvestigationfuzz

#48885 opened 1 year ago by mvdan

minimization takes longer than expected for very large []byte/stringNeedsFixfuzz

#48820 opened 2 years ago by katiehockman

custom mutator support for fuzzingFeatureRequestNeedsInvestigationfuzz

#48815 opened 2 years ago by s3nt3

unclear what t.Skip does in the context of fuzzingNeedsDecisionfuzz

#48779 opened 2 years ago by mvdan

a less error-prone API for benchmark iterationProposalProposal-Hold

#48768 opened 2 years ago by bcmills

fuzzed function can corrupt internal state of fuzzerFeatureRequestNeedsDecisionfuzz

#48606 opened 2 years ago by stevenjohnstone

minimized crasher is unrelated to originalNeedsInvestigationfuzz

#48326 opened 2 years ago by stevenjohnstone

report line number for F.Add call with mismatched typeNeedsFixfuzz

#48302 opened 2 years ago by jayconrod

successive integer and boolean mutations can be the sameNeedsInvestigationfuzz

#48291 opened 2 years ago by stevenjohnstone

would be useful to record fuzz crashers which cause OOM killsNeedsInvestigationfuzz

#47572 opened 2 years ago by stevenjohnstone

support subtests in fuzzerNeedsDecisionfuzz

#47413 opened 2 years ago by AlekSi

fuzz tests not discovered unless package path specified or GOMAXPROCS=1NeedsInvestigationfuzz

#47136 opened 2 years ago by kokes

failure messages should be easier to findNeedsInvestigation

#47080 opened 2 years ago by rogpeppe

colorize output on failing testsFeatureRequestNeedsInvestigation

#46921 opened 2 years ago by wymli

sub fuzz targetsFeatureRequestNeedsDecisionfuzz

#46780 opened 2 years ago by srikrsna

visualize fuzz corpus coverageFeatureRequestNeedsInvestigationfuzz

#46765 opened 2 years ago by rolandshoemaker

support custom dictionaries in fuzzerFeatureRequestNeedsInvestigationfuzz

#46508 opened 2 years ago by rolandshoemaker

possible fuzzing strategiesNeedsInvestigationfuzz

#46507 opened 2 years ago by rolandshoemaker

Ambiguous error message for wrong `-benchtime` valueGoCommandNeedsFix

#46043 opened 2 years ago by umi0410

fuzz inputs that return interesting outputs should continue to be fuzzedNeedsInvestigationfuzz

#45761 opened 2 years ago by rolandshoemaker

consider having timeouts in test binaries be recoverable/handledProposal

#44929 opened 2 years ago by dprotaso

dependencies in init functions are not recorded in the 'go test' cache keyGoCommandNeedsInvestigation

#44625 opened 2 years ago by aronatkins

clarify when TestMain is appropriate and notDocumentationNeedsInvestigation

#44200 opened 2 years ago by matttproud

benchmark unit propertiesProposalProposal-AcceptedProposal-FinalCommentPeriod

#43744 opened 2 years ago by aclements

document that directories returned by TB.TempDir should not be accessed after cleanupDocumentationNeedsFixhelp wanted

#43547 opened 2 years ago by howardjohn

relax lower-case suffix requirement for example test annotationProposal

#43528 opened 2 years ago by kortschak

don't overwrite race detector exit codeNeedsInvestigation

#43001 opened 2 years ago by hansbogert

document -test.benchmem and ReportAllocs output formatDocumentationNeedsFixhelp wanted

#42239 opened 2 years ago by ianlancetaylor

show diffs for incorrect output from Example testsProposalProposal-AcceptedProposal-FinalCommentPeriod

#41980 opened 2 years ago by komuw

run Cleanup if SIGINT occursNeedsInvestigation

#41891 opened 2 years ago by katiehockman

Provide `TestMain` with stats so that it can print a custom summary.Proposal

#41878 opened 2 years ago by michael-schaller

document rules for using TBDocumentationNeedsInvestigationhelp wanted

#41269 opened 2 years ago by dsymonds

test failes if leaving files without write permission in T.TempDirNeedsInvestigation

#40853 opened 2 years ago by atetubou

Document that T.Log and friends should not be invoked after the end of the test DocumentationNeedsInvestigationhelp wanted

#40343 opened 2 years ago by slinkydeveloper

Add LogWriter() method to testing.T for usage with log.LoggerProposal

#39519 opened 2 years ago by nhooyr

reuse the iteration number of the first round when count > 1Proposal

#38000 opened 3 years ago by shawndx

calculate 'grain' in different way if specifying -benchtime=NxProposal

#37996 opened 3 years ago by shawndx

Docs unclear what Cleanup does when called in a subtest.DocumentationNeedsInvestigation

#37333 opened 3 years ago by brackendawson

go test JSON output reports failure if stdout redirectedNeedsInvestigation

#37304 opened 3 years ago by james-johnston-thumbtack

when using a custom TestMain, m.Run does not return if one of the tests it runs panicsNeedsInvestigation

#37206 opened 3 years ago by orlangure

testing Log functions do not capture timestampNeedsInvestigation

#36656 opened 3 years ago by vimalk78

no way to properly distribute non-trivial runnable examplesNeedsInvestigation

#36586 opened 3 years ago by mvdan

reconsider adding Context method to testing.TProposal

#36532 opened 3 years ago by rogpeppe

the overview documentation on (*T) Run is unclearDocumentationNeedsInvestigation

#35824 opened 3 years ago by opennota

t.Parallel in a subtest masks races with the outer test functionNeedsInvestigation

#35670 opened 3 years ago by bcmills

better information about debugging test cache failuresNeedsInvestigationhelp wanted

#35301 opened 3 years ago by kevinburke

Benchmark prints nothing on failureNeedsInvestigation

#32066 opened 3 years ago by rogpeppe

parallel benchmark results are poorly documentedDocumentationNeedsFix

#31884 opened 3 years ago by aclements

Inconsistent benchmark data when GOMAXPROCS=1NeedsInvestigation

#31599 opened 4 years ago by xuanjiazhen

support explicitly running non-hermetic (or non-deterministic) examplesNeedsInvestigation

#31310 opened 4 years ago by mvdan

exclude unreachable code in test coverageFeatureRequestNeedsDecision

#31280 opened 4 years ago by santhosh-tekuri

benchmark is using low resolution time on WindowsNeedsInvestigationPerformanceTesting

#31160 opened 4 years ago by egonelbre

benchmark performance misaligned for fast testsNeedsInvestigationTesting

#30928 opened 4 years ago by kokes

loses log messages made in a goroutine after test has completedNeedsFix

#30389 opened 4 years ago by ianlancetaylor

move gomaxprocs to key-value pair in benchmark outputNeedsFixearly-in-cycle

#30056 opened 4 years ago by rsc

Benchmark calls during benchmarks deadlockNeedsFix

#29727 opened 4 years ago by empijei

Logf not reported outside of inner benchmark runNeedsInvestigation

#29211 opened 4 years ago by griesemer

t.FailNow() in a deferred function masks test panicNeedsInvestigation

#29207 opened 4 years ago by matthewmcnew

test output interleaves with race-detector warningsNeedsInvestigation

#29156 opened 4 years ago by mfridman

Benchmark reporting incorrect stats when running in parallelNeedsInvestigation

#28813 opened 4 years ago by mnewswanger

No way to view untruncated output from benchmarksNeedsDecision

#27901 opened 4 years ago by Minnozz

testing a list of packages blocks the real-time outputNeedsInvestigationTesting

#27826 opened 4 years ago by mwf

document best practices for avoiding compiler optimizations in benchmarksDocumentationNeedsInvestigationhelp wanted

#27400 opened 4 years ago by nicksnyder

tiny benchmark with StopTimer runs foreverNeedsInvestigation

#27217 opened 4 years ago by peterGo

examples with trailing whitespace in multiple lines of output can be confusingNeedsInvestigation

#26460 opened 4 years ago by joesis

parallel test output reported in non-deterministic orderNeedsInvestigation

#26440 opened 4 years ago by rsc

add a flag to detect unnecessary skipsProposalProposal-Hold

#25951 opened 4 years ago by bcmills

show rusage statistics for benchmarksNeedsInvestigation

#24905 opened 5 years ago by LMMilewski

start test log for caching before TestMainNeedsDecision

#24122 opened 5 years ago by bakatz

only find the target b.N once when -count > 1NeedsFixhelp wanted

#23423 opened 5 years ago by cespare

update documentation to be clear about when parallel subtests runDocumentationNeedsFixhelp wanted

#23368 opened 5 years ago by zwass

Helper's highest function call's information should be maintained for any subsequent/nested callsNeedsFixhelp wanted

#23249 opened 5 years ago by mattcary

collect performance counters for benchmarksProposalProposal-Accepted

#21295 opened 5 years ago by cherrymui

allow examples to return an errorProposalProposal-Hold

#21111 opened 5 years ago by rogpeppe

consider calling ReadMemStats less during benchmarkingNeedsFixPerformance

#20875 opened 5 years ago by josharian

output hard to read when a test case is stallingNeedsInvestigationhelp wanted

#19397 opened 6 years ago by rakyll

add -benchsplit to get more data pointsFeatureRequestNeedsFixProposalProposal-Acceptedhelp wanted

#19128 opened 6 years ago by bcmills

complain loudly during concurrent use of T.FatalX and T.SkipXNeedsFixhelp wanted

#15758 opened 6 years ago by dsnet

autodetect appropriate benchtime

#10930 opened 7 years ago by josharian

show more benchmark data

#10669 opened 8 years ago by rsc

measure coverage inside boolean expressionshelp wanted

#8741 opened 8 years ago by josharian

add ratcheting variants

#7465 opened 9 years ago by josharian

add test helpers for measuring goroutine leaks

#6705 opened 9 years ago by bradfitz