testing

New Issue

go test -n is missing the creation of _testmain.goNeedsInvestigation

#66592 opened 2 weeks ago by Snaipe

Creating sub-benchmark with b.Run means that parent will not show anything from b.ReportMetricNeedsInvestigation

#66353 opened 1 month ago by HaraldNordgren

TestDeepSubtestRace failuresNeedsInvestigation

#66183 opened 1 month ago by gopherbot

TestRaceDuringParallelFailsAllSubtests failuresNeedsInvestigationRaceDetectorcompiler/runtime

#66098 opened 1 month ago by gopherbot

add `testing.F.Corpus` to help with cross tests conversionProposal

#65253 opened 2 months ago by Jorropo

writeProfiles is not called after panicNeedsInvestigation

#65129 opened 3 months ago by felixge

allow examples the use of testing.T/B/F for test framework examplesProposal

#64993 opened 3 months ago by hugelgupf

parallel tests exceed `-test.parallel` flag if `T.Run` is called from multiple goroutinesNeedsFix

#64470 opened 4 months ago by bcmills

add TB.CleanupErrProposal

#63257 opened 6 months ago by mvdan

TestBRun failuresNeedsInvestigation

#62996 opened 7 months ago by gopherbot

annotate output text typeProposalProposal-Accepted

#62728 opened 7 months ago by mknyszek

TB.TempDir paths can be too long for Unix socket pathsNeedsDecisionUnfortunate

#62614 opened 7 months ago by bradfitz

add TB.ChdirProposal

#62516 opened 7 months ago by kolyshkin

Coverage() returns different values in 1.21 than 1.19.XNeedsInvestigation

#62212 opened 8 months ago by lbergesio

add TB.SetGOMAXPROCS Proposal

#62020 opened 8 months ago by sivchari

Collect test failure logs on the testing.common struct and expose collected logs via a new method on testing.TBProposal

#61860 opened 8 months ago by SophisticaSean

report non-zero exit status in -json outputProposalProposal-Accepted

#61839 opened 8 months ago by goto1134

verbose output should print package path before printing test outputProposal

#61647 opened 8 months ago by willfaught

use $GOTMPDIR for temporary files when setOS-WindowsProposalProposal-Accepted

#61585 opened 8 months ago by UnaffiliatedCode

add testing.B.Loop for iterationProposalProposal-Accepted

#61515 opened 9 months ago by aclements

shuffle seed should be different when -shuffle=on and -count flag is setProposalProposal-Accepted

#61256 opened 9 months ago by cristaloleg

add Keep, to force evaluation in benchmarksProposalProposal-Hold

#61179 opened 9 months ago by aclements

add fields to BenchmarkResult to report errors, skips, and logsProposal

#61050 opened 9 months ago by bcmills

failures in Cleanup functions do not trigger -failfast if the test includes a parallel subtestNeedsFix

#61034 opened 9 months ago by bcmills

flag to continue testing after -failfast failureProposal

#61009 opened 9 months ago by sparr

fail if the same test function is defined in both the `_test` and non-`_test` packagesProposal

#60977 opened 10 months ago by bcmills

make Testing return a compile-time constantProposal

#60772 opened 10 months ago by rsc

support underscore separators in -benchtime countsNeedsDecision

#60176 opened 11 months ago by mvdan

parent B.Cleanup() functions do not run if a sub-benchmark panicsNeedsInvestigationhelp wanted

#60129 opened 11 months ago by evanj

Add T.Output() etcProposal

#59928 opened 11 months ago by earthboundkid

add function to set output writer Proposal

#59454 opened 1 year ago by peterebden

Sub-benchmark that returns testing.BenchResults struct; maybe testing.B.Execute?Proposal

#59300 opened 1 year ago by ayang64

per-subtest setup and cleanupProposal

#59291 opened 1 year ago by unkeep

Testable examples collapse `Output` newlines, making them impossible to passNeedsFixhelp wanted

#59191 opened 1 year ago by keilin-anz

data race is attributed to wrong test in -json formatting NeedsInvestigation

#58634 opened 1 year ago by vearutop

calling `t.Helper()` in a goroutine logs asm file names, not the one from the call siteNeedsInvestigationcompiler/runtime

#58545 opened 1 year ago by pmalek

output timing and outcome of TestMain or possible setup and teardown functionsProposal

#57326 opened 1 year ago by doron-cohen

document how to export unexported identifiers in *_test.go DocumentationNeedsInvestigation

#56995 opened 1 year ago by changkun

fuzz reports spurious "process hung or terminated unexpectedly" errorsNeedsFixfuzz

#56238 opened 2 years ago by rsc

Listing the topN most time-consuming test cases as the last outputProposal

#54198 opened 2 years ago by bo-er

benchmark output should include settings like GOAMD64FeatureRequestNeedsInvestigation

#53782 opened 2 years ago by mvdan

coverprofile can't profile coverage of test cases themselvesNeedsInvestigation

#53508 opened 2 years ago by seebs

add Name to track file and line of test case declarationProposalProposal-Accepted

#52751 opened 2 years ago by dsnet

fuzzer aborts with "fuzzing process hung or terminated unexpectedly while minimizing: EOF"NeedsInvestigation

#52569 opened 2 years ago by lmb

report GC/op when b.ReportAllocs is calledProposalProposal-Accepted

#52466 opened 2 years ago by mknyszek

respect -count when running fuzz corpus testsNeedsInvestigation

#52464 opened 2 years ago by elias-orijtech

Whether to support printing random corpus in the futureNeedsInvestigation

#51745 opened 2 years ago by gcggcg

normalize line endings in output comparisonsNeedsInvestigation

#51269 opened 2 years ago by benhoyt

link to fuzzing guide and more details on runtimeDocumentationNeedsFixfuzz

#51032 opened 2 years ago by ronaldpetty

run first benchmark with last value from -cpu list GOMAXPROCS valueNeedsInvestigation

#49980 opened 2 years ago by KochankovID

benchmark timeout when benchtime set too longNeedsInvestigation

#49973 opened 2 years ago by lkxiaolou

t.Failed() returns false during panicNeedsFix

#49929 opened 2 years ago by gbuenoandrade

fuzz funcs that panic print redundant stack framesNeedsInvestigationfuzz

#48885 opened 2 years ago by mvdan

minimization takes longer than expected for very large []byte/stringNeedsFixfuzz

#48820 opened 2 years ago by katiehockman

custom mutator support for fuzzingFeatureRequestNeedsInvestigationProposalfuzz

#48815 opened 2 years ago by s3nt3

unclear what t.Skip does in the context of fuzzingNeedsDecisionfuzz

#48779 opened 2 years ago by mvdan

fuzzed function can corrupt internal state of fuzzerFeatureRequestNeedsDecisionfuzz

#48606 opened 2 years ago by stevenjohnstone

minimized crasher is unrelated to originalNeedsInvestigationfuzz

#48326 opened 2 years ago by stevenjohnstone

report line number for F.Add call with mismatched typeNeedsFixfuzz

#48302 opened 2 years ago by jayconrod

successive integer and boolean mutations can be the sameNeedsInvestigationfuzz

#48291 opened 2 years ago by stevenjohnstone

would be useful to record fuzz crashers which cause OOM killsNeedsInvestigationfuzz

#47572 opened 2 years ago by stevenjohnstone

support subtests in fuzzerNeedsDecisionfuzz

#47413 opened 2 years ago by AlekSi

fuzz tests not discovered unless package path specified or GOMAXPROCS=1NeedsInvestigationfuzz

#47136 opened 2 years ago by kokes

failure messages should be easier to findNeedsInvestigation

#47080 opened 2 years ago by rogpeppe

colorize output on failing testsFeatureRequestNeedsInvestigation

#46921 opened 2 years ago by wymli

sub fuzz targetsFeatureRequestNeedsDecisionfuzz

#46780 opened 2 years ago by srikrsna

visualize fuzz corpus coverageFeatureRequestNeedsInvestigationfuzz

#46765 opened 2 years ago by rolandshoemaker

support custom dictionaries in fuzzerFeatureRequestNeedsInvestigationfuzz

#46508 opened 2 years ago by rolandshoemaker

possible fuzzing strategiesNeedsInvestigationfuzz

#46507 opened 2 years ago by rolandshoemaker

Ambiguous error message for wrong `-benchtime` valueGoCommandNeedsFix

#46043 opened 2 years ago by umi0410

fuzz inputs that return interesting outputs should continue to be fuzzedNeedsInvestigationfuzz

#45761 opened 3 years ago by rolandshoemaker

consider having timeouts in test binaries be recoverable/handledProposal

#44929 opened 3 years ago by dprotaso

dependencies in init functions are not recorded in the 'go test' cache keyGoCommandNeedsInvestigation

#44625 opened 3 years ago by aronatkins

clarify when TestMain is appropriate and notDocumentationNeedsInvestigation

#44200 opened 3 years ago by matttproud

benchmark unit propertiesProposalProposal-Accepted

#43744 opened 3 years ago by aclements

document that directories returned by TB.TempDir should not be accessed after cleanupDocumentationNeedsFixhelp wanted

#43547 opened 3 years ago by howardjohn

relax lower-case suffix requirement for example test annotationProposal

#43528 opened 3 years ago by kortschak

don't overwrite race detector exit codeNeedsInvestigation

#43001 opened 3 years ago by hansbogert

document -test.benchmem and ReportAllocs output formatDocumentationNeedsFixhelp wanted

#42239 opened 3 years ago by ianlancetaylor

show diffs for incorrect output from Example testsProposalProposal-Accepted

#41980 opened 3 years ago by komuw

run Cleanup if SIGINT occursNeedsInvestigation

#41891 opened 3 years ago by katiehockman

Provide `TestMain` with stats so that it can print a custom summary.Proposal

#41878 opened 3 years ago by michael-schaller

document rules for using TBDocumentationNeedsInvestigationhelp wanted

#41269 opened 3 years ago by dsymonds

test failes if leaving files without write permission in T.TempDirNeedsInvestigation

#40853 opened 3 years ago by atetubou

Document that T.Log and friends should not be invoked after the end of the test DocumentationNeedsInvestigationhelp wanted

#40343 opened 3 years ago by slinkydeveloper

Add LogWriter() method to testing.T for usage with log.LoggerProposal

#39519 opened 3 years ago by nhooyr

reuse the iteration number of the first round when count > 1Proposal

#38000 opened 4 years ago by shawndx

calculate 'grain' in different way if specifying -benchtime=NxProposal

#37996 opened 4 years ago by shawndx

Docs unclear what Cleanup does when called in a subtest.DocumentationNeedsInvestigation

#37333 opened 4 years ago by brackendawson

go test JSON output reports failure if stdout redirectedNeedsInvestigation

#37304 opened 4 years ago by james-johnston-thumbtack

when using a custom TestMain, m.Run does not return if one of the tests it runs panicsNeedsInvestigation

#37206 opened 4 years ago by orlangure

testing Log functions do not capture timestampNeedsInvestigation

#36656 opened 4 years ago by vimalk78

no way to properly distribute non-trivial runnable examplesNeedsInvestigation

#36586 opened 4 years ago by mvdan

reconsider adding Context method to testing.TProposal

#36532 opened 4 years ago by rogpeppe

the overview documentation on (*T) Run is unclearDocumentationNeedsInvestigation

#35824 opened 4 years ago by opennota

t.Parallel in a subtest masks races with the outer test functionNeedsInvestigation

#35670 opened 4 years ago by bcmills

better information about debugging test cache failuresNeedsInvestigationhelp wanted

#35301 opened 4 years ago by kevinburke

Benchmark prints nothing on failureNeedsInvestigation

#32066 opened 5 years ago by rogpeppe

parallel benchmark results are poorly documentedDocumentationNeedsFix

#31884 opened 5 years ago by aclements

Inconsistent benchmark data when GOMAXPROCS=1NeedsInvestigation

#31599 opened 5 years ago by xuanjiazhen

support explicitly running non-hermetic (or non-deterministic) examplesNeedsInvestigation

#31310 opened 5 years ago by mvdan

exclude statically unreachable code in test coverageFeatureRequestNeedsDecision

#31280 opened 5 years ago by santhosh-tekuri

benchmark is using low resolution time on WindowsNeedsInvestigationPerformanceTesting

#31160 opened 5 years ago by egonelbre

benchmark performance misaligned for fast testsNeedsInvestigationTesting

#30928 opened 5 years ago by kokes

loses log messages made in a goroutine after test has completedNeedsFix

#30389 opened 5 years ago by ianlancetaylor

move gomaxprocs to key-value pair in benchmark outputNeedsFixearly-in-cycle

#30056 opened 5 years ago by rsc

Benchmark calls during benchmarks deadlockNeedsFix

#29727 opened 5 years ago by empijei

Logf not reported outside of inner benchmark runNeedsInvestigation

#29211 opened 5 years ago by griesemer

t.FailNow() in a deferred function masks test panicNeedsInvestigation

#29207 opened 5 years ago by matthewmcnew

Benchmark reporting incorrect stats when running in parallelNeedsInvestigation

#28813 opened 5 years ago by mnewswanger

No way to view untruncated output from benchmarksNeedsDecision

#27901 opened 5 years ago by Minnozz

testing a list of packages blocks the real-time outputNeedsInvestigationTesting

#27826 opened 5 years ago by mwf

document best practices for avoiding compiler optimizations in benchmarksDocumentationNeedsInvestigationhelp wanted

#27400 opened 5 years ago by nicksnyder

tiny benchmark with StopTimer runs foreverNeedsInvestigation

#27217 opened 5 years ago by peterGo

examples with trailing whitespace in multiple lines of output can be confusingNeedsInvestigation

#26460 opened 5 years ago by joesis

parallel test output reported in non-deterministic orderNeedsInvestigation

#26440 opened 5 years ago by rsc

add a flag to detect unnecessary skipsProposalProposal-Hold

#25951 opened 5 years ago by bcmills

show rusage statistics for benchmarksNeedsInvestigation

#24905 opened 6 years ago by LMMilewski

start test log for caching before TestMainNeedsDecision

#24122 opened 6 years ago by bakatz

only find the target b.N once when -count > 1NeedsFixhelp wanted

#23423 opened 6 years ago by cespare

update documentation to be clear about when parallel subtests runDocumentationNeedsFixhelp wanted

#23368 opened 6 years ago by zwass

Helper's highest function call's information should be maintained for any subsequent/nested callsNeedsFixhelp wanted

#23249 opened 6 years ago by mattcary

collect performance counters for benchmarksProposalProposal-Accepted

#21295 opened 6 years ago by cherrymui

allow examples to return an errorProposalProposal-Hold

#21111 opened 6 years ago by rogpeppe

consider calling ReadMemStats less during benchmarkingNeedsFixPerformance

#20875 opened 6 years ago by josharian

output hard to read when a test case is stallingNeedsInvestigationhelp wanted

#19397 opened 7 years ago by rakyll

add -benchsplit to get more data pointsFeatureRequestNeedsFixProposalProposal-Acceptedhelp wanted

#19128 opened 7 years ago by bcmills

complain loudly during concurrent use of T.FatalX and T.SkipXNeedsFixhelp wanted

#15758 opened 8 years ago by dsnet

autodetect appropriate benchtime

#10930 opened 9 years ago by josharian

show more benchmark data

#10669 opened 9 years ago by rsc

measure coverage inside boolean expressionshelp wanted

#8741 opened 9 years ago by josharian

add ratcheting variants

#7465 opened 10 years ago by josharian

add test helpers for measuring goroutine leaks

#6705 opened 10 years ago by bradfitz