[SPARK-7558] Demarcate tests in unit-tests.log

Right now unit-tests.log are not of much value because we can't tell where the test boundaries are easily. This patch adds log statements before and after each test to outline the test boundaries, e.g.:
===== TEST OUTPUT FOR o.a.s.serializer.KryoSerializerSuite: 'kryo with parallelize for primitive arrays' =====

15/05/27 12:36:39.596 pool-1-thread-1-ScalaTest-running-KryoSerializerSuite INFO SparkContext: Starting job: count at KryoSerializerSuite.scala:230
15/05/27 12:36:39.596 dag-scheduler-event-loop INFO DAGScheduler: Got job 3 (count at KryoSerializerSuite.scala:230) with 4 output partitions (allowLocal=false)
15/05/27 12:36:39.596 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 3(count at KryoSerializerSuite.scala:230)
15/05/27 12:36:39.596 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List()
15/05/27 12:36:39.597 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List()
15/05/27 12:36:39.597 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 3 (ParallelCollectionRDD[5] at parallelize at KryoSerializerSuite.scala:230), which has no missing parents

...

15/05/27 12:36:39.624 pool-1-thread-1-ScalaTest-running-KryoSerializerSuite INFO DAGScheduler: Job 3 finished: count at KryoSerializerSuite.scala:230, took 0.028563 s
15/05/27 12:36:39.625 pool-1-thread-1-ScalaTest-running-KryoSerializerSuite INFO KryoSerializerSuite:

***** FINISHED o.a.s.serializer.KryoSerializerSuite: 'kryo with parallelize for primitive arrays' *****

...

@JoshRosen @pwendell

Merged build triggered.

Merged build started.

Test build #33608 has started for   PR 6441 at commit 35ee432.

Can we modify the style checker / linter to fail the build if someone commits a new test which uses FunSuite directly instead of using SparkFunSuite?

Test build #33608 has finished for   PR 6441 at commit 35ee432.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33608/
Test FAILed.

Build triggered.

Build started.

Test build #33619 has started for   PR 6441 at commit 69cbb24.

Merged build triggered.

Merged build started.

Test build #33621 has started for   PR 6441 at commit fa9450e.

Can you use the same patterns for the start and finish thresholds? Any reason to use === and then ***?
===== TEST OUTPUT FOR o.a.s.serializer.KryoSerializerSuite: 'kryo with parallelize for primitive arrays' =====
***** FINISHED o.a.s.serializer.KryoSerializerSuite: 'kryo with parallelize for primitive arrays' *****

I can use the same one. Which one do you prefer?

Test build #33619 has finished for   PR 6441 at commit 69cbb24.

This patch fails Spark unit tests.
This patch does not merge cleanly.
This patch adds the following public classes (experimental):
class BagelSuite extends SparkFunSuite with Assertions with BeforeAndAfter with Timeouts
class AccumulatorSuite extends SparkFunSuite with Matchers with LocalSparkContext
class CheckpointSuite extends SparkFunSuite with LocalSparkContext with Logging
class DistributedSuite extends SparkFunSuite with Matchers with LocalSparkContext
class DriverSuite extends SparkFunSuite with Timeouts
class FailureSuite extends SparkFunSuite with LocalSparkContext
class FileServerSuite extends SparkFunSuite with LocalSparkContext
class FileSuite extends SparkFunSuite with LocalSparkContext
class HeartbeatReceiverSuite extends SparkFunSuite with LocalSparkContext
class ImplicitOrderingSuite extends SparkFunSuite with LocalSparkContext
class MapOutputTrackerSuite extends SparkFunSuite
class PartitioningSuite extends SparkFunSuite with SharedSparkContext with PrivateMethodTester
class SSLOptionsSuite extends SparkFunSuite with BeforeAndAfterAll
class SecurityManagerSuite extends SparkFunSuite
abstract class ShuffleSuite extends SparkFunSuite with Matchers with LocalSparkContext
class SparkConfSuite extends SparkFunSuite with LocalSparkContext with ResetSystemProperties
class SparkContextInfoSuite extends SparkFunSuite with LocalSparkContext
class SparkContextSuite extends SparkFunSuite with LocalSparkContext
  * the
class StatusTrackerSuite extends SparkFunSuite with Matchers with LocalSparkContext
class ThreadingSuite extends SparkFunSuite with LocalSparkContext
class UnpersistSuite extends SparkFunSuite with LocalSparkContext
class PythonBroadcastSuite extends SparkFunSuite with Matchers with SharedSparkContext
class PythonRDDSuite extends SparkFunSuite
class SerDeUtilSuite extends SparkFunSuite with SharedSparkContext
class BroadcastSuite extends SparkFunSuite with LocalSparkContext
class ClientSuite extends SparkFunSuite with Matchers
class JsonProtocolSuite extends SparkFunSuite with JsonTestUtils
class LogUrlsStandaloneSuite extends SparkFunSuite with LocalSparkContext
class PythonRunnerSuite extends SparkFunSuite
class SparkSubmitUtilsSuite extends SparkFunSuite with BeforeAndAfterAll
class FsHistoryProviderSuite extends SparkFunSuite with BeforeAndAfter with Matchers with Logging
class MasterSuite extends SparkFunSuite with Matchers with Eventually
class StandaloneRestSubmitSuite extends SparkFunSuite with BeforeAndAfterEach
class SubmitRestProtocolSuite extends SparkFunSuite
class CommandUtilsSuite extends SparkFunSuite with Matchers
class DriverRunnerTest extends SparkFunSuite
class ExecutorRunnerTest extends SparkFunSuite
class WorkerArgumentsTest extends SparkFunSuite
class WorkerSuite extends SparkFunSuite with Matchers
class WorkerWatcherSuite extends SparkFunSuite
class TaskMetricsSuite extends SparkFunSuite
class WholeTextFileRecordReaderSuite extends SparkFunSuite with BeforeAndAfterAll
class CompressionCodecSuite extends SparkFunSuite
class MetricsConfigSuite extends SparkFunSuite with BeforeAndAfter
class MetricsSystemSuite extends SparkFunSuite with BeforeAndAfter with PrivateMethodTester
class NettyBlockTransferSecuritySuite extends SparkFunSuite with MockitoSugar with ShouldMatchers
class ConnectionManagerSuite extends SparkFunSuite
class AsyncRDDActionsSuite extends SparkFunSuite with BeforeAndAfterAll with Timeouts
class DoubleRDDSuite extends SparkFunSuite with SharedSparkContext
class JdbcRDDSuite extends SparkFunSuite with BeforeAndAfter with LocalSparkContext
class PairRDDFunctionsSuite extends SparkFunSuite with SharedSparkContext
class ParallelCollectionSplitSuite extends SparkFunSuite with Checkers
class PartitionPruningRDDSuite extends SparkFunSuite with SharedSparkContext
class PartitionwiseSampledRDDSuite extends SparkFunSuite with SharedSparkContext
class PipedRDDSuite extends SparkFunSuite with SharedSparkContext
class RDDOperationScopeSuite extends SparkFunSuite with BeforeAndAfter
class RDDSuite extends SparkFunSuite with SharedSparkContext
class SortingSuite extends SparkFunSuite with SharedSparkContext with Matchers with Logging
class ZippedPartitionsSuite extends SparkFunSuite with SharedSparkContext
abstract class RpcEnvSuite extends SparkFunSuite with BeforeAndAfterAll
class CoarseGrainedSchedulerBackendSuite extends SparkFunSuite with LocalSparkContext
class MapStatusSuite extends SparkFunSuite
class OutputCommitCoordinatorSuite extends SparkFunSuite with BeforeAndAfter
class PoolSuite extends SparkFunSuite with LocalSparkContext
class ReplayListenerSuite extends SparkFunSuite with BeforeAndAfter
class TaskContextSuite extends SparkFunSuite with BeforeAndAfter with LocalSparkContext
class TaskResultGetterSuite extends SparkFunSuite with BeforeAndAfter with LocalSparkContext
class TaskSchedulerImplSuite extends SparkFunSuite with LocalSparkContext with Logging
class TaskSetManagerSuite extends SparkFunSuite with LocalSparkContext with Logging
class MemoryUtilsSuite extends SparkFunSuite with MockitoSugar
class MesosSchedulerBackendSuite extends SparkFunSuite with LocalSparkContext with MockitoSugar
class MesosTaskLaunchDataSuite extends SparkFunSuite
class MesosClusterSchedulerSuite extends SparkFunSuite with LocalSparkContext with MockitoSugar
class JavaSerializerSuite extends SparkFunSuite
class KryoSerializerDistributedSuite extends SparkFunSuite
class KryoSerializerResizableOutputSuite extends SparkFunSuite
class KryoSerializerSuite extends SparkFunSuite with SharedSparkContext
class ProactiveClosureSerializationSuite extends SparkFunSuite with SharedSparkContext
class SerializationDebuggerSuite extends SparkFunSuite with BeforeAndAfterEach
class SerializerPropertiesSuite extends SparkFunSuite
class ShuffleMemoryManagerSuite extends SparkFunSuite with Timeouts
class HashShuffleManagerSuite extends SparkFunSuite with LocalSparkContext
class UnsafeShuffleManagerSuite extends SparkFunSuite with Matchers
class SimpleDateParamSuite extends SparkFunSuite with Matchers
class BlockIdSuite extends SparkFunSuite
class BlockManagerReplicationSuite extends SparkFunSuite with Matchers with BeforeAndAfter
class BlockObjectWriterSuite extends SparkFunSuite
class DiskBlockManagerSuite extends SparkFunSuite with BeforeAndAfterEach with BeforeAndAfterAll
class FlatmapIteratorSuite extends SparkFunSuite with LocalSparkContext
class LocalDirsSuite extends SparkFunSuite with BeforeAndAfter
class ShuffleBlockFetcherIteratorSuite extends SparkFunSuite
class StorageStatusListenerSuite extends SparkFunSuite
class StorageSuite extends SparkFunSuite
class UISeleniumSuite extends SparkFunSuite with WebBrowser with Matchers with BeforeAndAfterAll
class UISuite extends SparkFunSuite
class JobProgressListenerSuite extends SparkFunSuite with LocalSparkContext with Matchers
class RDDOperationGraphListenerSuite extends SparkFunSuite
class StorageTabSuite extends SparkFunSuite with BeforeAndAfter
class AkkaUtilsSuite extends SparkFunSuite with LocalSparkContext with ResetSystemProperties
class ClosureCleanerSuite extends SparkFunSuite
class ClosureCleanerSuite2 extends SparkFunSuite with BeforeAndAfterAll with PrivateMethodTester
class CompletionIteratorSuite extends SparkFunSuite
class DistributionSuite extends SparkFunSuite with Matchers
class EventLoopSuite extends SparkFunSuite with Timeouts
class FileAppenderSuite extends SparkFunSuite with BeforeAndAfter with Logging
class JsonProtocolSuite extends SparkFunSuite
class MutableURLClassLoaderSuite extends SparkFunSuite
class NextIteratorSuite extends SparkFunSuite with Matchers
class ThreadUtilsSuite extends SparkFunSuite
class TimeStampedHashMapSuite extends SparkFunSuite
class UtilsSuite extends SparkFunSuite with ResetSystemProperties with Logging
class VectorSuite extends SparkFunSuite
class AppendOnlyMapSuite extends SparkFunSuite
class BitSetSuite extends SparkFunSuite
class ChainedBufferSuite extends SparkFunSuite
class CompactBufferSuite extends SparkFunSuite
class ExternalAppendOnlyMapSuite extends SparkFunSuite with LocalSparkContext
class ExternalSorterSuite extends SparkFunSuite with LocalSparkContext with PrivateMethodTester
class OpenHashMapSuite extends SparkFunSuite with Matchers
class OpenHashSetSuite extends SparkFunSuite with Matchers
class PartitionedSerializedPairBufferSuite extends SparkFunSuite
class PrimitiveKeyOpenHashMapSuite extends SparkFunSuite with Matchers
class PrimitiveVectorSuite extends SparkFunSuite
class SizeTrackerSuite extends SparkFunSuite
class SorterSuite extends SparkFunSuite
class ByteArrayChunkOutputStreamSuite extends SparkFunSuite
class RandomSamplerSuite extends SparkFunSuite with Matchers
class SamplingUtilsSuite extends SparkFunSuite
class XORShiftRandomSuite extends SparkFunSuite with Matchers
class SparkSinkSuite extends SparkFunSuite
class FlumePollingStreamSuite extends SparkFunSuite with BeforeAndAfter with Logging
class FlumeStreamSuite extends SparkFunSuite with BeforeAndAfter with Matchers with Logging
class KafkaClusterSuite extends SparkFunSuite with BeforeAndAfterAll
class KafkaRDDSuite extends SparkFunSuite with BeforeAndAfterAll
class KafkaStreamSuite extends SparkFunSuite with Eventually with BeforeAndAfterAll
class MQTTStreamSuite extends SparkFunSuite with Eventually with BeforeAndAfter
class TwitterStreamSuite extends SparkFunSuite with BeforeAndAfter with Logging
class ZeroMQStreamSuite extends SparkFunSuite
class EdgeRDDSuite extends SparkFunSuite with LocalSparkContext
class EdgeSuite extends SparkFunSuite
class GraphOpsSuite extends SparkFunSuite with LocalSparkContext
class GraphSuite extends SparkFunSuite with LocalSparkContext
class PregelSuite extends SparkFunSuite with LocalSparkContext
class VertexRDDSuite extends SparkFunSuite with LocalSparkContext
class EdgePartitionSuite extends SparkFunSuite
class VertexPartitionSuite extends SparkFunSuite
class ConnectedComponentsSuite extends SparkFunSuite with LocalSparkContext
class LabelPropagationSuite extends SparkFunSuite with LocalSparkContext
class PageRankSuite extends SparkFunSuite with LocalSparkContext
class SVDPlusPlusSuite extends SparkFunSuite with LocalSparkContext
class ShortestPathsSuite extends SparkFunSuite with LocalSparkContext
class StronglyConnectedComponentsSuite extends SparkFunSuite with LocalSparkContext
class TriangleCountSuite extends SparkFunSuite with LocalSparkContext
class BytecodeUtilsSuite extends SparkFunSuite
class GraphGeneratorsSuite extends SparkFunSuite with LocalSparkContext
class IdentifiableSuite extends SparkFunSuite
class PipelineSuite extends SparkFunSuite
class AttributeGroupSuite extends SparkFunSuite
class AttributeSuite extends SparkFunSuite
class DecisionTreeClassifierSuite extends SparkFunSuite with MLlibTestSparkContext
class GBTClassifierSuite extends SparkFunSuite with MLlibTestSparkContext
class LogisticRegressionSuite extends SparkFunSuite with MLlibTestSparkContext
class OneVsRestSuite extends SparkFunSuite with MLlibTestSparkContext
class RandomForestClassifierSuite extends SparkFunSuite with MLlibTestSparkContext
class RegressionEvaluatorSuite extends SparkFunSuite with MLlibTestSparkContext
class BinarizerSuite extends SparkFunSuite with MLlibTestSparkContext
class BucketizerSuite extends SparkFunSuite with MLlibTestSparkContext
class HashingTFSuite extends SparkFunSuite with MLlibTestSparkContext
class IDFSuite extends SparkFunSuite with MLlibTestSparkContext
class NormalizerSuite extends SparkFunSuite with MLlibTestSparkContext
class OneHotEncoderSuite extends SparkFunSuite with MLlibTestSparkContext
class PolynomialExpansionSuite extends SparkFunSuite with MLlibTestSparkContext
class StringIndexerSuite extends SparkFunSuite with MLlibTestSparkContext
class RegexTokenizerSuite extends SparkFunSuite with MLlibTestSparkContext
class VectorAssemblerSuite extends SparkFunSuite with MLlibTestSparkContext
class VectorIndexerSuite extends SparkFunSuite with MLlibTestSparkContext
class Word2VecSuite extends SparkFunSuite with MLlibTestSparkContext
class ParamsSuite extends SparkFunSuite
class SharedParamsSuite extends SparkFunSuite
class ALSSuite extends SparkFunSuite with MLlibTestSparkContext with Logging
class DecisionTreeRegressorSuite extends SparkFunSuite with MLlibTestSparkContext
class GBTRegressorSuite extends SparkFunSuite with MLlibTestSparkContext
class LinearRegressionSuite extends SparkFunSuite with MLlibTestSparkContext
class RandomForestRegressorSuite extends SparkFunSuite with MLlibTestSparkContext
class CrossValidatorSuite extends SparkFunSuite with MLlibTestSparkContext
class ParamGridBuilderSuite extends SparkFunSuite
class PythonMLLibAPISuite extends SparkFunSuite
class LogisticRegressionSuite extends SparkFunSuite with MLlibTestSparkContext with Matchers
class LogisticRegressionClusterSuite extends SparkFunSuite with LocalClusterSparkContext
class NaiveBayesSuite extends SparkFunSuite with MLlibTestSparkContext
class NaiveBayesClusterSuite extends SparkFunSuite with LocalClusterSparkContext
class SVMSuite extends SparkFunSuite with MLlibTestSparkContext
class SVMClusterSuite extends SparkFunSuite with LocalClusterSparkContext
class StreamingLogisticRegressionSuite extends SparkFunSuite with TestSuiteBase
class GaussianMixtureSuite extends SparkFunSuite with MLlibTestSparkContext
class KMeansSuite extends SparkFunSuite with MLlibTestSparkContext
class KMeansClusterSuite extends SparkFunSuite with LocalClusterSparkContext
class LDASuite extends SparkFunSuite with MLlibTestSparkContext
class PowerIterationClusteringSuite extends SparkFunSuite with MLlibTestSparkContext
class StreamingKMeansSuite extends SparkFunSuite with TestSuiteBase
class AreaUnderCurveSuite extends SparkFunSuite with MLlibTestSparkContext
class BinaryClassificationMetricsSuite extends SparkFunSuite with MLlibTestSparkContext
class MulticlassMetricsSuite extends SparkFunSuite with MLlibTestSparkContext
class MultilabelMetricsSuite extends SparkFunSuite with MLlibTestSparkContext
class RankingMetricsSuite extends SparkFunSuite with MLlibTestSparkContext
class RegressionMetricsSuite extends SparkFunSuite with MLlibTestSparkContext
class ChiSqSelectorSuite extends SparkFunSuite with MLlibTestSparkContext
class ElementwiseProductSuite extends SparkFunSuite with MLlibTestSparkContext
class HashingTFSuite extends SparkFunSuite with MLlibTestSparkContext
class IDFSuite extends SparkFunSuite with MLlibTestSparkContext
class NormalizerSuite extends SparkFunSuite with MLlibTestSparkContext
class PCASuite extends SparkFunSuite with MLlibTestSparkContext
class StandardScalerSuite extends SparkFunSuite with MLlibTestSparkContext
class Word2VecSuite extends SparkFunSuite with MLlibTestSparkContext
class FPGrowthSuite extends SparkFunSuite with MLlibTestSparkContext
class FPTreeSuite extends SparkFunSuite with MLlibTestSparkContext
class PeriodicGraphCheckpointerSuite extends SparkFunSuite with MLlibTestSparkContext
class BLASSuite extends SparkFunSuite
class BreezeMatrixConversionSuite extends SparkFunSuite
class BreezeVectorConversionSuite extends SparkFunSuite
class MatricesSuite extends SparkFunSuite
class VectorsSuite extends SparkFunSuite
class BlockMatrixSuite extends SparkFunSuite with MLlibTestSparkContext
class CoordinateMatrixSuite extends SparkFunSuite with MLlibTestSparkContext
class IndexedRowMatrixSuite extends SparkFunSuite with MLlibTestSparkContext
class RowMatrixSuite extends SparkFunSuite with MLlibTestSparkContext
class RowMatrixClusterSuite extends SparkFunSuite with LocalClusterSparkContext
class GradientDescentSuite extends SparkFunSuite with MLlibTestSparkContext with Matchers
class GradientDescentClusterSuite extends SparkFunSuite with LocalClusterSparkContext
class LBFGSSuite extends SparkFunSuite with MLlibTestSparkContext with Matchers
class LBFGSClusterSuite extends SparkFunSuite with LocalClusterSparkContext
class NNLSSuite extends SparkFunSuite
class BinaryClassificationPMMLModelExportSuite extends SparkFunSuite
class GeneralizedLinearPMMLModelExportSuite extends SparkFunSuite
class KMeansPMMLModelExportSuite extends SparkFunSuite
class PMMLModelExportFactorySuite extends SparkFunSuite
class RandomDataGeneratorSuite extends SparkFunSuite
class RandomRDDsSuite extends SparkFunSuite with MLlibTestSparkContext with Serializable
class MLPairRDDFunctionsSuite extends SparkFunSuite with MLlibTestSparkContext
class RDDFunctionsSuite extends SparkFunSuite with MLlibTestSparkContext
class ALSSuite extends SparkFunSuite with MLlibTestSparkContext
class MatrixFactorizationModelSuite extends SparkFunSuite with MLlibTestSparkContext
class IsotonicRegressionSuite extends SparkFunSuite with MLlibTestSparkContext with Matchers
class LabeledPointSuite extends SparkFunSuite
class LassoSuite extends SparkFunSuite with MLlibTestSparkContext
class LassoClusterSuite extends SparkFunSuite with LocalClusterSparkContext
class LinearRegressionSuite extends SparkFunSuite with MLlibTestSparkContext
class LinearRegressionClusterSuite extends SparkFunSuite with LocalClusterSparkContext
class RidgeRegressionSuite extends SparkFunSuite with MLlibTestSparkContext
class RidgeRegressionClusterSuite extends SparkFunSuite with LocalClusterSparkContext
class StreamingLinearRegressionSuite extends SparkFunSuite with TestSuiteBase
class CorrelationSuite extends SparkFunSuite with MLlibTestSparkContext
class HypothesisTestSuite extends SparkFunSuite with MLlibTestSparkContext
class KernelDensitySuite extends SparkFunSuite with MLlibTestSparkContext
class MultivariateOnlineSummarizerSuite extends SparkFunSuite
class MultivariateGaussianSuite extends SparkFunSuite with MLlibTestSparkContext
class DecisionTreeSuite extends SparkFunSuite with MLlibTestSparkContext
class GradientBoostedTreesSuite extends SparkFunSuite with MLlibTestSparkContext
class ImpuritySuite extends SparkFunSuite with MLlibTestSparkContext
class RandomForestSuite extends SparkFunSuite with MLlibTestSparkContext
class BaggedPointSuite extends SparkFunSuite with MLlibTestSparkContext
class MLUtilsSuite extends SparkFunSuite with MLlibTestSparkContext
class NumericParserSuite extends SparkFunSuite
class TestingUtilsSuite extends SparkFunSuite
class ReplSuite extends SparkFunSuite
class ReplSuite extends SparkFunSuite
class DistributionSuite extends SparkFunSuite
class ScalaReflectionSuite extends SparkFunSuite
class SqlParserSuite extends SparkFunSuite
class AnalysisSuite extends SparkFunSuite with BeforeAndAfter
class DecimalPrecisionSuite extends SparkFunSuite with BeforeAndAfter
class AttributeSetSuite extends SparkFunSuite
class ExpressionEvaluationBaseSuite extends SparkFunSuite
class UnsafeRowConverterSuite extends SparkFunSuite with Matchers
class PlanTest extends SparkFunSuite
class SameResultSuite extends SparkFunSuite
class RuleExecutorSuite extends SparkFunSuite
class TreeNodeSuite extends SparkFunSuite
class MetadataSuite extends SparkFunSuite
class DataTypeParserSuite extends SparkFunSuite
class DataTypeSuite extends SparkFunSuite
class UTF8StringSuite extends SparkFunSuite
class DecimalSuite extends SparkFunSuite with PrivateMethodTester
class DataFrameStatSuite extends SparkFunSuite
class RowSuite extends SparkFunSuite
class SQLConfSuite extends QueryTest
class SQLContextSuite extends SparkFunSuite with BeforeAndAfterAll
class ScalaReflectionRelationSuite extends SparkFunSuite
class SerializationSuite extends SparkFunSuite
class ColumnStatsSuite extends SparkFunSuite
class ColumnTypeSuite extends SparkFunSuite with Logging
class NullableColumnAccessorSuite extends SparkFunSuite
class NullableColumnBuilderSuite extends SparkFunSuite
class PartitionBatchPruningSuite extends SparkFunSuite with BeforeAndAfterAll with BeforeAndAfter
class BooleanBitSetSuite extends SparkFunSuite
class DictionaryEncodingSuite extends SparkFunSuite
class IntegralDeltaSuite extends SparkFunSuite
class RunLengthEncodingSuite extends SparkFunSuite
class PlannerSuite extends SparkFunSuite
class SparkSqlSerializer2DataTypeSuite extends SparkFunSuite
class DebuggingSuite extends SparkFunSuite
class HashedRelationSuite extends SparkFunSuite
class JDBCSuite extends SparkFunSuite with BeforeAndAfter
class JDBCWriteSuite extends SparkFunSuite with BeforeAndAfter
class ParquetSchemaSuite extends SparkFunSuite with ParquetTest
class ResolvedDataSourceSuite extends SparkFunSuite
class CliSuite extends SparkFunSuite with BeforeAndAfter with Logging
abstract class HiveThriftServer2Test extends SparkFunSuite with BeforeAndAfterAll with Logging
class HiveInspectorSuite extends SparkFunSuite with HiveInspectors
class HiveMetastoreCatalogSuite extends SparkFunSuite
class HiveQlSuite extends SparkFunSuite with BeforeAndAfterAll
class SerializationSuite extends SparkFunSuite
class VersionsSuite extends SparkFunSuite with Logging
class ConcurrentHiveSuite extends SparkFunSuite with BeforeAndAfterAll
class OrcPartitionDiscoverySuite extends QueryTest with BeforeAndAfterAll
class OrcQuerySuite extends QueryTest with BeforeAndAfterAll with OrcTest
class CommitFailureTestRelationSuite extends SparkFunSuite with SQLTestUtils
class DStreamClosureSuite extends SparkFunSuite with BeforeAndAfterAll
class DStreamScopeSuite extends SparkFunSuite with BeforeAndAfter with BeforeAndAfterAll
class StreamingContextSuite extends SparkFunSuite with BeforeAndAfter with Timeouts with Logging
trait TestSuiteBase extends SparkFunSuite with BeforeAndAfter with Logging
class InputInfoTrackerSuite extends SparkFunSuite with BeforeAndAfter
class UIUtilsSuite extends SparkFunSuite with Matchers
class RateLimitedOutputStreamSuite extends SparkFunSuite
class WriteAheadLogSuite extends SparkFunSuite with BeforeAndAfter
class ClientDistributedCacheManagerSuite extends SparkFunSuite with MockitoSugar
class ClientSuite extends SparkFunSuite with Matchers with BeforeAndAfterAll
class YarnAllocatorSuite extends SparkFunSuite with Matchers with BeforeAndAfterEach
class YarnClusterSuite extends SparkFunSuite with BeforeAndAfterAll with Matchers with Logging
class YarnSparkHadoopUtilSuite extends SparkFunSuite with Matchers with Logging

Build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33619/
Test FAILed.

Test build #33621 has finished for   PR 6441 at commit fa9450e.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33621/
Test FAILed.

Merged build triggered.

Merged build started.

Test build #33630 has started for   PR 6441 at commit ee22cda.

Test build #33630 has finished for   PR 6441 at commit ee22cda.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds the following public classes (experimental):
class BagelSuite extends SparkFunSuite with Assertions with BeforeAndAfter with Timeouts
class AccumulatorSuite extends SparkFunSuite with Matchers with LocalSparkContext
class CheckpointSuite extends SparkFunSuite with LocalSparkContext with Logging
class DistributedSuite extends SparkFunSuite with Matchers with LocalSparkContext
class DriverSuite extends SparkFunSuite with Timeouts
class FailureSuite extends SparkFunSuite with LocalSparkContext
class FileServerSuite extends SparkFunSuite with LocalSparkContext
class FileSuite extends SparkFunSuite with LocalSparkContext
class HeartbeatReceiverSuite extends SparkFunSuite with LocalSparkContext
class ImplicitOrderingSuite extends SparkFunSuite with LocalSparkContext
class MapOutputTrackerSuite extends SparkFunSuite
class PartitioningSuite extends SparkFunSuite with SharedSparkContext with PrivateMethodTester
class SSLOptionsSuite extends SparkFunSuite with BeforeAndAfterAll
class SecurityManagerSuite extends SparkFunSuite
abstract class ShuffleSuite extends SparkFunSuite with Matchers with LocalSparkContext
class SparkConfSuite extends SparkFunSuite with LocalSparkContext with ResetSystemProperties
class SparkContextInfoSuite extends SparkFunSuite with LocalSparkContext
class SparkContextSuite extends SparkFunSuite with LocalSparkContext
  * the
class StatusTrackerSuite extends SparkFunSuite with Matchers with LocalSparkContext
class ThreadingSuite extends SparkFunSuite with LocalSparkContext
class UnpersistSuite extends SparkFunSuite with LocalSparkContext
class PythonBroadcastSuite extends SparkFunSuite with Matchers with SharedSparkContext
class PythonRDDSuite extends SparkFunSuite
class SerDeUtilSuite extends SparkFunSuite with SharedSparkContext
class BroadcastSuite extends SparkFunSuite with LocalSparkContext
class ClientSuite extends SparkFunSuite with Matchers
class JsonProtocolSuite extends SparkFunSuite with JsonTestUtils
class LogUrlsStandaloneSuite extends SparkFunSuite with LocalSparkContext
class PythonRunnerSuite extends SparkFunSuite
class SparkSubmitUtilsSuite extends SparkFunSuite with BeforeAndAfterAll
class FsHistoryProviderSuite extends SparkFunSuite with BeforeAndAfter with Matchers with Logging
class MasterSuite extends SparkFunSuite with Matchers with Eventually
class StandaloneRestSubmitSuite extends SparkFunSuite with BeforeAndAfterEach
class SubmitRestProtocolSuite extends SparkFunSuite
class CommandUtilsSuite extends SparkFunSuite with Matchers
class DriverRunnerTest extends SparkFunSuite
class ExecutorRunnerTest extends SparkFunSuite
class WorkerArgumentsTest extends SparkFunSuite
class WorkerSuite extends SparkFunSuite with Matchers
class WorkerWatcherSuite extends SparkFunSuite
class TaskMetricsSuite extends SparkFunSuite
class WholeTextFileRecordReaderSuite extends SparkFunSuite with BeforeAndAfterAll
class CompressionCodecSuite extends SparkFunSuite
class MetricsConfigSuite extends SparkFunSuite with BeforeAndAfter
class MetricsSystemSuite extends SparkFunSuite with BeforeAndAfter with PrivateMethodTester
class NettyBlockTransferSecuritySuite extends SparkFunSuite with MockitoSugar with ShouldMatchers
class ConnectionManagerSuite extends SparkFunSuite
class AsyncRDDActionsSuite extends SparkFunSuite with BeforeAndAfterAll with Timeouts
class DoubleRDDSuite extends SparkFunSuite with SharedSparkContext
class JdbcRDDSuite extends SparkFunSuite with BeforeAndAfter with LocalSparkContext
class PairRDDFunctionsSuite extends SparkFunSuite with SharedSparkContext
class ParallelCollectionSplitSuite extends SparkFunSuite with Checkers
class PartitionPruningRDDSuite extends SparkFunSuite with SharedSparkContext
class PartitionwiseSampledRDDSuite extends SparkFunSuite with SharedSparkContext
class PipedRDDSuite extends SparkFunSuite with SharedSparkContext
class RDDOperationScopeSuite extends SparkFunSuite with BeforeAndAfter
class RDDSuite extends SparkFunSuite with SharedSparkContext
class SortingSuite extends SparkFunSuite with SharedSparkContext with Matchers with Logging
class ZippedPartitionsSuite extends SparkFunSuite with SharedSparkContext
abstract class RpcEnvSuite extends SparkFunSuite with BeforeAndAfterAll
class CoarseGrainedSchedulerBackendSuite extends SparkFunSuite with LocalSparkContext
class MapStatusSuite extends SparkFunSuite
class OutputCommitCoordinatorSuite extends SparkFunSuite with BeforeAndAfter
class PoolSuite extends SparkFunSuite with LocalSparkContext
class ReplayListenerSuite extends SparkFunSuite with BeforeAndAfter
class TaskContextSuite extends SparkFunSuite with BeforeAndAfter with LocalSparkContext
class TaskResultGetterSuite extends SparkFunSuite with BeforeAndAfter with LocalSparkContext
class TaskSchedulerImplSuite extends SparkFunSuite with LocalSparkContext with Logging
class TaskSetManagerSuite extends SparkFunSuite with LocalSparkContext with Logging
class MemoryUtilsSuite extends SparkFunSuite with MockitoSugar
class MesosSchedulerBackendSuite extends SparkFunSuite with LocalSparkContext with MockitoSugar
class MesosTaskLaunchDataSuite extends SparkFunSuite
class MesosClusterSchedulerSuite extends SparkFunSuite with LocalSparkContext with MockitoSugar
class JavaSerializerSuite extends SparkFunSuite
class KryoSerializerDistributedSuite extends SparkFunSuite
class KryoSerializerResizableOutputSuite extends SparkFunSuite
class KryoSerializerSuite extends SparkFunSuite with SharedSparkContext
class ProactiveClosureSerializationSuite extends SparkFunSuite with SharedSparkContext
class SerializationDebuggerSuite extends SparkFunSuite with BeforeAndAfterEach
class SerializerPropertiesSuite extends SparkFunSuite
class ShuffleMemoryManagerSuite extends SparkFunSuite with Timeouts
class HashShuffleManagerSuite extends SparkFunSuite with LocalSparkContext
class UnsafeShuffleManagerSuite extends SparkFunSuite with Matchers
class SimpleDateParamSuite extends SparkFunSuite with Matchers
class BlockIdSuite extends SparkFunSuite
class BlockManagerReplicationSuite extends SparkFunSuite with Matchers with BeforeAndAfter
class BlockObjectWriterSuite extends SparkFunSuite
class DiskBlockManagerSuite extends SparkFunSuite with BeforeAndAfterEach with BeforeAndAfterAll
class FlatmapIteratorSuite extends SparkFunSuite with LocalSparkContext
class LocalDirsSuite extends SparkFunSuite with BeforeAndAfter
class ShuffleBlockFetcherIteratorSuite extends SparkFunSuite
class StorageStatusListenerSuite extends SparkFunSuite
class StorageSuite extends SparkFunSuite
class UISeleniumSuite extends SparkFunSuite with WebBrowser with Matchers with BeforeAndAfterAll
class UISuite extends SparkFunSuite
class JobProgressListenerSuite extends SparkFunSuite with LocalSparkContext with Matchers
class RDDOperationGraphListenerSuite extends SparkFunSuite
class StorageTabSuite extends SparkFunSuite with BeforeAndAfter
class AkkaUtilsSuite extends SparkFunSuite with LocalSparkContext with ResetSystemProperties
class ClosureCleanerSuite extends SparkFunSuite
class ClosureCleanerSuite2 extends SparkFunSuite with BeforeAndAfterAll with PrivateMethodTester
class CompletionIteratorSuite extends SparkFunSuite
class DistributionSuite extends SparkFunSuite with Matchers
class EventLoopSuite extends SparkFunSuite with Timeouts
class FileAppenderSuite extends SparkFunSuite with BeforeAndAfter with Logging
class JsonProtocolSuite extends SparkFunSuite
class MutableURLClassLoaderSuite extends SparkFunSuite
class NextIteratorSuite extends SparkFunSuite with Matchers
class ThreadUtilsSuite extends SparkFunSuite
class TimeStampedHashMapSuite extends SparkFunSuite
class UtilsSuite extends SparkFunSuite with ResetSystemProperties with Logging
class VectorSuite extends SparkFunSuite
class AppendOnlyMapSuite extends SparkFunSuite
class BitSetSuite extends SparkFunSuite
class ChainedBufferSuite extends SparkFunSuite
class CompactBufferSuite extends SparkFunSuite
class ExternalAppendOnlyMapSuite extends SparkFunSuite with LocalSparkContext
class ExternalSorterSuite extends SparkFunSuite with LocalSparkContext with PrivateMethodTester
class OpenHashMapSuite extends SparkFunSuite with Matchers
class OpenHashSetSuite extends SparkFunSuite with Matchers
class PartitionedSerializedPairBufferSuite extends SparkFunSuite
class PrimitiveKeyOpenHashMapSuite extends SparkFunSuite with Matchers
class PrimitiveVectorSuite extends SparkFunSuite
class SizeTrackerSuite extends SparkFunSuite
class SorterSuite extends SparkFunSuite
class ByteArrayChunkOutputStreamSuite extends SparkFunSuite
class RandomSamplerSuite extends SparkFunSuite with Matchers
class SamplingUtilsSuite extends SparkFunSuite
class XORShiftRandomSuite extends SparkFunSuite with Matchers
class SparkSinkSuite extends SparkFunSuite
class FlumePollingStreamSuite extends SparkFunSuite with BeforeAndAfter with Logging
class FlumeStreamSuite extends SparkFunSuite with BeforeAndAfter with Matchers with Logging
class KafkaClusterSuite extends SparkFunSuite with BeforeAndAfterAll
class KafkaRDDSuite extends SparkFunSuite with BeforeAndAfterAll
class KafkaStreamSuite extends SparkFunSuite with Eventually with BeforeAndAfterAll
class MQTTStreamSuite extends SparkFunSuite with Eventually with BeforeAndAfter
class TwitterStreamSuite extends SparkFunSuite with BeforeAndAfter with Logging
class ZeroMQStreamSuite extends SparkFunSuite
class EdgeRDDSuite extends SparkFunSuite with LocalSparkContext
class EdgeSuite extends SparkFunSuite
class GraphOpsSuite extends SparkFunSuite with LocalSparkContext
class GraphSuite extends SparkFunSuite with LocalSparkContext
class PregelSuite extends SparkFunSuite with LocalSparkContext
class VertexRDDSuite extends SparkFunSuite with LocalSparkContext
class EdgePartitionSuite extends SparkFunSuite
class VertexPartitionSuite extends SparkFunSuite
class ConnectedComponentsSuite extends SparkFunSuite with LocalSparkContext
class LabelPropagationSuite extends SparkFunSuite with LocalSparkContext
class PageRankSuite extends SparkFunSuite with LocalSparkContext
class SVDPlusPlusSuite extends SparkFunSuite with LocalSparkContext
class ShortestPathsSuite extends SparkFunSuite with LocalSparkContext
class StronglyConnectedComponentsSuite extends SparkFunSuite with LocalSparkContext
class TriangleCountSuite extends SparkFunSuite with LocalSparkContext
class BytecodeUtilsSuite extends SparkFunSuite
class GraphGeneratorsSuite extends SparkFunSuite with LocalSparkContext
class IdentifiableSuite extends SparkFunSuite
class PipelineSuite extends SparkFunSuite
class AttributeGroupSuite extends SparkFunSuite
class AttributeSuite extends SparkFunSuite
class DecisionTreeClassifierSuite extends SparkFunSuite with MLlibTestSparkContext
class GBTClassifierSuite extends SparkFunSuite with MLlibTestSparkContext
class LogisticRegressionSuite extends SparkFunSuite with MLlibTestSparkContext
class OneVsRestSuite extends SparkFunSuite with MLlibTestSparkContext
class RandomForestClassifierSuite extends SparkFunSuite with MLlibTestSparkContext
class RegressionEvaluatorSuite extends SparkFunSuite with MLlibTestSparkContext
class BinarizerSuite extends SparkFunSuite with MLlibTestSparkContext
class BucketizerSuite extends SparkFunSuite with MLlibTestSparkContext
class HashingTFSuite extends SparkFunSuite with MLlibTestSparkContext
class IDFSuite extends SparkFunSuite with MLlibTestSparkContext
class NormalizerSuite extends SparkFunSuite with MLlibTestSparkContext
class OneHotEncoderSuite extends SparkFunSuite with MLlibTestSparkContext
class PolynomialExpansionSuite extends SparkFunSuite with MLlibTestSparkContext
class StringIndexerSuite extends SparkFunSuite with MLlibTestSparkContext
class RegexTokenizerSuite extends SparkFunSuite with MLlibTestSparkContext
class VectorAssemblerSuite extends SparkFunSuite with MLlibTestSparkContext
class VectorIndexerSuite extends SparkFunSuite with MLlibTestSparkContext
class Word2VecSuite extends SparkFunSuite with MLlibTestSparkContext
class ParamsSuite extends SparkFunSuite
class SharedParamsSuite extends SparkFunSuite
class ALSSuite extends SparkFunSuite with MLlibTestSparkContext with Logging
class DecisionTreeRegressorSuite extends SparkFunSuite with MLlibTestSparkContext
class GBTRegressorSuite extends SparkFunSuite with MLlibTestSparkContext
class LinearRegressionSuite extends SparkFunSuite with MLlibTestSparkContext
class RandomForestRegressorSuite extends SparkFunSuite with MLlibTestSparkContext
class CrossValidatorSuite extends SparkFunSuite with MLlibTestSparkContext
class ParamGridBuilderSuite extends SparkFunSuite
class PythonMLLibAPISuite extends SparkFunSuite
class LogisticRegressionSuite extends SparkFunSuite with MLlibTestSparkContext with Matchers
class LogisticRegressionClusterSuite extends SparkFunSuite with LocalClusterSparkContext
class NaiveBayesSuite extends SparkFunSuite with MLlibTestSparkContext
class NaiveBayesClusterSuite extends SparkFunSuite with LocalClusterSparkContext
class SVMSuite extends SparkFunSuite with MLlibTestSparkContext
class SVMClusterSuite extends SparkFunSuite with LocalClusterSparkContext
class StreamingLogisticRegressionSuite extends SparkFunSuite with TestSuiteBase
class GaussianMixtureSuite extends SparkFunSuite with MLlibTestSparkContext
class KMeansSuite extends SparkFunSuite with MLlibTestSparkContext
class KMeansClusterSuite extends SparkFunSuite with LocalClusterSparkContext
class LDASuite extends SparkFunSuite with MLlibTestSparkContext
class PowerIterationClusteringSuite extends SparkFunSuite with MLlibTestSparkContext
class StreamingKMeansSuite extends SparkFunSuite with TestSuiteBase
class AreaUnderCurveSuite extends SparkFunSuite with MLlibTestSparkContext
class BinaryClassificationMetricsSuite extends SparkFunSuite with MLlibTestSparkContext
class MulticlassMetricsSuite extends SparkFunSuite with MLlibTestSparkContext
class MultilabelMetricsSuite extends SparkFunSuite with MLlibTestSparkContext
class RankingMetricsSuite extends SparkFunSuite with MLlibTestSparkContext
class RegressionMetricsSuite extends SparkFunSuite with MLlibTestSparkContext
class ChiSqSelectorSuite extends SparkFunSuite with MLlibTestSparkContext
class ElementwiseProductSuite extends SparkFunSuite with MLlibTestSparkContext
class HashingTFSuite extends SparkFunSuite with MLlibTestSparkContext
class IDFSuite extends SparkFunSuite with MLlibTestSparkContext
class NormalizerSuite extends SparkFunSuite with MLlibTestSparkContext
class PCASuite extends SparkFunSuite with MLlibTestSparkContext
class StandardScalerSuite extends SparkFunSuite with MLlibTestSparkContext
class Word2VecSuite extends SparkFunSuite with MLlibTestSparkContext
class FPGrowthSuite extends SparkFunSuite with MLlibTestSparkContext
class FPTreeSuite extends SparkFunSuite with MLlibTestSparkContext
class PeriodicGraphCheckpointerSuite extends SparkFunSuite with MLlibTestSparkContext
class BLASSuite extends SparkFunSuite
class BreezeMatrixConversionSuite extends SparkFunSuite
class BreezeVectorConversionSuite extends SparkFunSuite
class MatricesSuite extends SparkFunSuite
class VectorsSuite extends SparkFunSuite
class BlockMatrixSuite extends SparkFunSuite with MLlibTestSparkContext
class CoordinateMatrixSuite extends SparkFunSuite with MLlibTestSparkContext
class IndexedRowMatrixSuite extends SparkFunSuite with MLlibTestSparkContext
class RowMatrixSuite extends SparkFunSuite with MLlibTestSparkContext
class RowMatrixClusterSuite extends SparkFunSuite with LocalClusterSparkContext
class GradientDescentSuite extends SparkFunSuite with MLlibTestSparkContext with Matchers
class GradientDescentClusterSuite extends SparkFunSuite with LocalClusterSparkContext
class LBFGSSuite extends SparkFunSuite with MLlibTestSparkContext with Matchers
class LBFGSClusterSuite extends SparkFunSuite with LocalClusterSparkContext
class NNLSSuite extends SparkFunSuite
class BinaryClassificationPMMLModelExportSuite extends SparkFunSuite
class GeneralizedLinearPMMLModelExportSuite extends SparkFunSuite
class KMeansPMMLModelExportSuite extends SparkFunSuite
class PMMLModelExportFactorySuite extends SparkFunSuite
class RandomDataGeneratorSuite extends SparkFunSuite
class RandomRDDsSuite extends SparkFunSuite with MLlibTestSparkContext with Serializable
class MLPairRDDFunctionsSuite extends SparkFunSuite with MLlibTestSparkContext
class RDDFunctionsSuite extends SparkFunSuite with MLlibTestSparkContext
class ALSSuite extends SparkFunSuite with MLlibTestSparkContext
class MatrixFactorizationModelSuite extends SparkFunSuite with MLlibTestSparkContext
class IsotonicRegressionSuite extends SparkFunSuite with MLlibTestSparkContext with Matchers
class LabeledPointSuite extends SparkFunSuite
class LassoSuite extends SparkFunSuite with MLlibTestSparkContext
class LassoClusterSuite extends SparkFunSuite with LocalClusterSparkContext
class LinearRegressionSuite extends SparkFunSuite with MLlibTestSparkContext
class LinearRegressionClusterSuite extends SparkFunSuite with LocalClusterSparkContext
class RidgeRegressionSuite extends SparkFunSuite with MLlibTestSparkContext
class RidgeRegressionClusterSuite extends SparkFunSuite with LocalClusterSparkContext
class StreamingLinearRegressionSuite extends SparkFunSuite with TestSuiteBase
class CorrelationSuite extends SparkFunSuite with MLlibTestSparkContext
class HypothesisTestSuite extends SparkFunSuite with MLlibTestSparkContext
class KernelDensitySuite extends SparkFunSuite with MLlibTestSparkContext
class MultivariateOnlineSummarizerSuite extends SparkFunSuite
class MultivariateGaussianSuite extends SparkFunSuite with MLlibTestSparkContext
class DecisionTreeSuite extends SparkFunSuite with MLlibTestSparkContext
class GradientBoostedTreesSuite extends SparkFunSuite with MLlibTestSparkContext
class ImpuritySuite extends SparkFunSuite with MLlibTestSparkContext
class RandomForestSuite extends SparkFunSuite with MLlibTestSparkContext
class BaggedPointSuite extends SparkFunSuite with MLlibTestSparkContext
class MLUtilsSuite extends SparkFunSuite with MLlibTestSparkContext
class NumericParserSuite extends SparkFunSuite
class TestingUtilsSuite extends SparkFunSuite
class ReplSuite extends SparkFunSuite
class ReplSuite extends SparkFunSuite
class DistributionSuite extends SparkFunSuite
class ScalaReflectionSuite extends SparkFunSuite
class SqlParserSuite extends SparkFunSuite
class AnalysisSuite extends SparkFunSuite with BeforeAndAfter
class DecimalPrecisionSuite extends SparkFunSuite with BeforeAndAfter
class AttributeSetSuite extends SparkFunSuite
class ExpressionEvaluationBaseSuite extends SparkFunSuite
class UnsafeRowConverterSuite extends SparkFunSuite with Matchers
class PlanTest extends SparkFunSuite
class SameResultSuite extends SparkFunSuite
class RuleExecutorSuite extends SparkFunSuite
class TreeNodeSuite extends SparkFunSuite
class MetadataSuite extends SparkFunSuite
class DataTypeParserSuite extends SparkFunSuite
class DataTypeSuite extends SparkFunSuite
class UTF8StringSuite extends SparkFunSuite
class DecimalSuite extends SparkFunSuite with PrivateMethodTester
class DataFrameStatSuite extends SparkFunSuite
class RowSuite extends SparkFunSuite
class SQLConfSuite extends QueryTest
class SQLContextSuite extends SparkFunSuite with BeforeAndAfterAll
class ScalaReflectionRelationSuite extends SparkFunSuite
class SerializationSuite extends SparkFunSuite
class ColumnStatsSuite extends SparkFunSuite
class ColumnTypeSuite extends SparkFunSuite with Logging
class NullableColumnAccessorSuite extends SparkFunSuite
class NullableColumnBuilderSuite extends SparkFunSuite
class PartitionBatchPruningSuite extends SparkFunSuite with BeforeAndAfterAll with BeforeAndAfter
class BooleanBitSetSuite extends SparkFunSuite
class DictionaryEncodingSuite extends SparkFunSuite
class IntegralDeltaSuite extends SparkFunSuite
class RunLengthEncodingSuite extends SparkFunSuite
class PlannerSuite extends SparkFunSuite
class SparkSqlSerializer2DataTypeSuite extends SparkFunSuite
class DebuggingSuite extends SparkFunSuite
class HashedRelationSuite extends SparkFunSuite
class JDBCSuite extends SparkFunSuite with BeforeAndAfter
class JDBCWriteSuite extends SparkFunSuite with BeforeAndAfter
class ParquetSchemaSuite extends SparkFunSuite with ParquetTest
class ResolvedDataSourceSuite extends SparkFunSuite
class CliSuite extends SparkFunSuite with BeforeAndAfter with Logging
abstract class HiveThriftServer2Test extends SparkFunSuite with BeforeAndAfterAll with Logging
class HiveInspectorSuite extends SparkFunSuite with HiveInspectors
class HiveMetastoreCatalogSuite extends SparkFunSuite
class HiveQlSuite extends SparkFunSuite with BeforeAndAfterAll
class SerializationSuite extends SparkFunSuite
class VersionsSuite extends SparkFunSuite with Logging
class ConcurrentHiveSuite extends SparkFunSuite with BeforeAndAfterAll
class OrcPartitionDiscoverySuite extends QueryTest with BeforeAndAfterAll
class OrcQuerySuite extends QueryTest with BeforeAndAfterAll with OrcTest
class CommitFailureTestRelationSuite extends SparkFunSuite with SQLTestUtils
class DStreamClosureSuite extends SparkFunSuite with BeforeAndAfterAll
class DStreamScopeSuite extends SparkFunSuite with BeforeAndAfter with BeforeAndAfterAll
class StreamingContextSuite extends SparkFunSuite with BeforeAndAfter with Timeouts with Logging
trait TestSuiteBase extends SparkFunSuite with BeforeAndAfter with Logging
class InputInfoTrackerSuite extends SparkFunSuite with BeforeAndAfter
class UIUtilsSuite extends SparkFunSuite with Matchers
class RateLimitedOutputStreamSuite extends SparkFunSuite
class WriteAheadLogSuite extends SparkFunSuite with BeforeAndAfter
class ClientDistributedCacheManagerSuite extends SparkFunSuite with MockitoSugar
class ClientSuite extends SparkFunSuite with Matchers with BeforeAndAfterAll
class YarnAllocatorSuite extends SparkFunSuite with Matchers with BeforeAndAfterEach
class YarnClusterSuite extends SparkFunSuite with BeforeAndAfterAll with Matchers with Logging
class YarnSparkHadoopUtilSuite extends SparkFunSuite with Matchers with Logging

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33630/
Test FAILed.

Merged build finished. Test FAILed.

I dug into this a bit about why this is failing. It turns out that core/test depends on guava 15 (from tachyon), while core depends on guava 14. The full error message is a java.lang.IllegalAccessError complaining that a certain method in guava cannot be accessed; this is frequently caused by classpath issues.
In commit da0b12f403735470596e427d22a6d8238432dbae we made catalyst/test depend on core/test. This is a problem since hive/test depends on catalyst/test, so we are indirectly packaging guava 15 into hive tests.

Can we exclude guava from tachyon in the test dependency?

Patrick

On Wed, May 27, 2015 at 8:56 PM, andrewor14<EMAIL_ADDRESS>wrote:

I dug into this a bit about why this is failing. It turns out that
core/test depends on guava 15 (from tachyon), while core depends on guava
14. The full error message is a java.lang.IllegalAccessError complaining
that a certain method in guava cannot be accessed; this is frequently
caused by classpath issues.
In commit da0b12f
https://github.com/apache/spark/commit/da0b12f403735470596e427d22a6d8238432dbae
we made catalyst/test depend on core/test. This is a problem since
hive/test depends on catalyst/test, so we are indirectly packaging guava
15 into hive tests.
—
Reply to this email directly or view it on GitHub
https://github.com/apache/spark/pull/6441#issuecomment-106163938.

Yeah I'm doing that right now

Alright, it turns out that it was selenium, not tachyon, that was bundling guava 15. I tested out the latest changes locally and tests should now pass.

@JoshRosen that's a great suggestion, though one that I would prefer to implement after the test scripts are converted to python (ongoing at #5694).

Merged build triggered.

Merged build started.

Test build #33643 has started for   PR 6441 at commit 8882581.

Test build #33643 has finished for   PR 6441 at commit 8882581.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds the following public classes (experimental):
class BagelSuite extends SparkFunSuite with Assertions with BeforeAndAfter with Timeouts
class AccumulatorSuite extends SparkFunSuite with Matchers with LocalSparkContext
class CheckpointSuite extends SparkFunSuite with LocalSparkContext with Logging
class DistributedSuite extends SparkFunSuite with Matchers with LocalSparkContext
class DriverSuite extends SparkFunSuite with Timeouts
class FailureSuite extends SparkFunSuite with LocalSparkContext
class FileServerSuite extends SparkFunSuite with LocalSparkContext
class FileSuite extends SparkFunSuite with LocalSparkContext
class HeartbeatReceiverSuite extends SparkFunSuite with LocalSparkContext
class ImplicitOrderingSuite extends SparkFunSuite with LocalSparkContext
class MapOutputTrackerSuite extends SparkFunSuite
class PartitioningSuite extends SparkFunSuite with SharedSparkContext with PrivateMethodTester
class SSLOptionsSuite extends SparkFunSuite with BeforeAndAfterAll
class SecurityManagerSuite extends SparkFunSuite
abstract class ShuffleSuite extends SparkFunSuite with Matchers with LocalSparkContext
class SparkConfSuite extends SparkFunSuite with LocalSparkContext with ResetSystemProperties
class SparkContextInfoSuite extends SparkFunSuite with LocalSparkContext
class SparkContextSuite extends SparkFunSuite with LocalSparkContext
  * the
class StatusTrackerSuite extends SparkFunSuite with Matchers with LocalSparkContext
class ThreadingSuite extends SparkFunSuite with LocalSparkContext
class UnpersistSuite extends SparkFunSuite with LocalSparkContext
class PythonBroadcastSuite extends SparkFunSuite with Matchers with SharedSparkContext
class PythonRDDSuite extends SparkFunSuite
class SerDeUtilSuite extends SparkFunSuite with SharedSparkContext
class BroadcastSuite extends SparkFunSuite with LocalSparkContext
class ClientSuite extends SparkFunSuite with Matchers
class JsonProtocolSuite extends SparkFunSuite with JsonTestUtils
class LogUrlsStandaloneSuite extends SparkFunSuite with LocalSparkContext
class PythonRunnerSuite extends SparkFunSuite
class SparkSubmitUtilsSuite extends SparkFunSuite with BeforeAndAfterAll
class FsHistoryProviderSuite extends SparkFunSuite with BeforeAndAfter with Matchers with Logging
class MasterSuite extends SparkFunSuite with Matchers with Eventually
class StandaloneRestSubmitSuite extends SparkFunSuite with BeforeAndAfterEach
class SubmitRestProtocolSuite extends SparkFunSuite
class CommandUtilsSuite extends SparkFunSuite with Matchers
class DriverRunnerTest extends SparkFunSuite
class ExecutorRunnerTest extends SparkFunSuite
class WorkerArgumentsTest extends SparkFunSuite
class WorkerSuite extends SparkFunSuite with Matchers
class WorkerWatcherSuite extends SparkFunSuite
class TaskMetricsSuite extends SparkFunSuite
class WholeTextFileRecordReaderSuite extends SparkFunSuite with BeforeAndAfterAll
class CompressionCodecSuite extends SparkFunSuite
class MetricsConfigSuite extends SparkFunSuite with BeforeAndAfter
class MetricsSystemSuite extends SparkFunSuite with BeforeAndAfter with PrivateMethodTester
class NettyBlockTransferSecuritySuite extends SparkFunSuite with MockitoSugar with ShouldMatchers
class ConnectionManagerSuite extends SparkFunSuite
class AsyncRDDActionsSuite extends SparkFunSuite with BeforeAndAfterAll with Timeouts
class DoubleRDDSuite extends SparkFunSuite with SharedSparkContext
class JdbcRDDSuite extends SparkFunSuite with BeforeAndAfter with LocalSparkContext
class PairRDDFunctionsSuite extends SparkFunSuite with SharedSparkContext
class ParallelCollectionSplitSuite extends SparkFunSuite with Checkers
class PartitionPruningRDDSuite extends SparkFunSuite with SharedSparkContext
class PartitionwiseSampledRDDSuite extends SparkFunSuite with SharedSparkContext
class PipedRDDSuite extends SparkFunSuite with SharedSparkContext
class RDDOperationScopeSuite extends SparkFunSuite with BeforeAndAfter
class RDDSuite extends SparkFunSuite with SharedSparkContext
class SortingSuite extends SparkFunSuite with SharedSparkContext with Matchers with Logging
class ZippedPartitionsSuite extends SparkFunSuite with SharedSparkContext
abstract class RpcEnvSuite extends SparkFunSuite with BeforeAndAfterAll
class CoarseGrainedSchedulerBackendSuite extends SparkFunSuite with LocalSparkContext
class MapStatusSuite extends SparkFunSuite
class OutputCommitCoordinatorSuite extends SparkFunSuite with BeforeAndAfter
class PoolSuite extends SparkFunSuite with LocalSparkContext
class ReplayListenerSuite extends SparkFunSuite with BeforeAndAfter
class TaskContextSuite extends SparkFunSuite with BeforeAndAfter with LocalSparkContext
class TaskResultGetterSuite extends SparkFunSuite with BeforeAndAfter with LocalSparkContext
class TaskSchedulerImplSuite extends SparkFunSuite with LocalSparkContext with Logging
class TaskSetManagerSuite extends SparkFunSuite with LocalSparkContext with Logging
class MemoryUtilsSuite extends SparkFunSuite with MockitoSugar
class MesosSchedulerBackendSuite extends SparkFunSuite with LocalSparkContext with MockitoSugar
class MesosTaskLaunchDataSuite extends SparkFunSuite
class MesosClusterSchedulerSuite extends SparkFunSuite with LocalSparkContext with MockitoSugar
class JavaSerializerSuite extends SparkFunSuite
class KryoSerializerDistributedSuite extends SparkFunSuite
class KryoSerializerResizableOutputSuite extends SparkFunSuite
class KryoSerializerSuite extends SparkFunSuite with SharedSparkContext
class ProactiveClosureSerializationSuite extends SparkFunSuite with SharedSparkContext
class SerializationDebuggerSuite extends SparkFunSuite with BeforeAndAfterEach
class SerializerPropertiesSuite extends SparkFunSuite
class ShuffleMemoryManagerSuite extends SparkFunSuite with Timeouts
class HashShuffleManagerSuite extends SparkFunSuite with LocalSparkContext
class UnsafeShuffleManagerSuite extends SparkFunSuite with Matchers
class SimpleDateParamSuite extends SparkFunSuite with Matchers
class BlockIdSuite extends SparkFunSuite
class BlockManagerReplicationSuite extends SparkFunSuite with Matchers with BeforeAndAfter
class BlockObjectWriterSuite extends SparkFunSuite
class DiskBlockManagerSuite extends SparkFunSuite with BeforeAndAfterEach with BeforeAndAfterAll
class FlatmapIteratorSuite extends SparkFunSuite with LocalSparkContext
class LocalDirsSuite extends SparkFunSuite with BeforeAndAfter
class ShuffleBlockFetcherIteratorSuite extends SparkFunSuite
class StorageStatusListenerSuite extends SparkFunSuite
class StorageSuite extends SparkFunSuite
class UISeleniumSuite extends SparkFunSuite with WebBrowser with Matchers with BeforeAndAfterAll
class UISuite extends SparkFunSuite
class JobProgressListenerSuite extends SparkFunSuite with LocalSparkContext with Matchers
class RDDOperationGraphListenerSuite extends SparkFunSuite
class StorageTabSuite extends SparkFunSuite with BeforeAndAfter
class AkkaUtilsSuite extends SparkFunSuite with LocalSparkContext with ResetSystemProperties
class ClosureCleanerSuite extends SparkFunSuite
class ClosureCleanerSuite2 extends SparkFunSuite with BeforeAndAfterAll with PrivateMethodTester
class CompletionIteratorSuite extends SparkFunSuite
class DistributionSuite extends SparkFunSuite with Matchers
class EventLoopSuite extends SparkFunSuite with Timeouts
class FileAppenderSuite extends SparkFunSuite with BeforeAndAfter with Logging
class JsonProtocolSuite extends SparkFunSuite
class MutableURLClassLoaderSuite extends SparkFunSuite
class NextIteratorSuite extends SparkFunSuite with Matchers
class ThreadUtilsSuite extends SparkFunSuite
class TimeStampedHashMapSuite extends SparkFunSuite
class UtilsSuite extends SparkFunSuite with ResetSystemProperties with Logging
class VectorSuite extends SparkFunSuite
class AppendOnlyMapSuite extends SparkFunSuite
class BitSetSuite extends SparkFunSuite
class ChainedBufferSuite extends SparkFunSuite
class CompactBufferSuite extends SparkFunSuite
class ExternalAppendOnlyMapSuite extends SparkFunSuite with LocalSparkContext
class ExternalSorterSuite extends SparkFunSuite with LocalSparkContext with PrivateMethodTester
class OpenHashMapSuite extends SparkFunSuite with Matchers
class OpenHashSetSuite extends SparkFunSuite with Matchers
class PartitionedSerializedPairBufferSuite extends SparkFunSuite
class PrimitiveKeyOpenHashMapSuite extends SparkFunSuite with Matchers
class PrimitiveVectorSuite extends SparkFunSuite
class SizeTrackerSuite extends SparkFunSuite
class SorterSuite extends SparkFunSuite
class ByteArrayChunkOutputStreamSuite extends SparkFunSuite
class RandomSamplerSuite extends SparkFunSuite with Matchers
class SamplingUtilsSuite extends SparkFunSuite
class XORShiftRandomSuite extends SparkFunSuite with Matchers
class SparkSinkSuite extends SparkFunSuite
class FlumePollingStreamSuite extends SparkFunSuite with BeforeAndAfter with Logging
class FlumeStreamSuite extends SparkFunSuite with BeforeAndAfter with Matchers with Logging
class KafkaClusterSuite extends SparkFunSuite with BeforeAndAfterAll
class KafkaRDDSuite extends SparkFunSuite with BeforeAndAfterAll
class KafkaStreamSuite extends SparkFunSuite with Eventually with BeforeAndAfterAll
class MQTTStreamSuite extends SparkFunSuite with Eventually with BeforeAndAfter
class TwitterStreamSuite extends SparkFunSuite with BeforeAndAfter with Logging
class ZeroMQStreamSuite extends SparkFunSuite
class EdgeRDDSuite extends SparkFunSuite with LocalSparkContext
class EdgeSuite extends SparkFunSuite
class GraphOpsSuite extends SparkFunSuite with LocalSparkContext
class GraphSuite extends SparkFunSuite with LocalSparkContext
class PregelSuite extends SparkFunSuite with LocalSparkContext
class VertexRDDSuite extends SparkFunSuite with LocalSparkContext
class EdgePartitionSuite extends SparkFunSuite
class VertexPartitionSuite extends SparkFunSuite
class ConnectedComponentsSuite extends SparkFunSuite with LocalSparkContext
class LabelPropagationSuite extends SparkFunSuite with LocalSparkContext
class PageRankSuite extends SparkFunSuite with LocalSparkContext
class SVDPlusPlusSuite extends SparkFunSuite with LocalSparkContext
class ShortestPathsSuite extends SparkFunSuite with LocalSparkContext
class StronglyConnectedComponentsSuite extends SparkFunSuite with LocalSparkContext
class TriangleCountSuite extends SparkFunSuite with LocalSparkContext
class BytecodeUtilsSuite extends SparkFunSuite
class GraphGeneratorsSuite extends SparkFunSuite with LocalSparkContext
class IdentifiableSuite extends SparkFunSuite
class PipelineSuite extends SparkFunSuite
class AttributeGroupSuite extends SparkFunSuite
class AttributeSuite extends SparkFunSuite
class DecisionTreeClassifierSuite extends SparkFunSuite with MLlibTestSparkContext
class GBTClassifierSuite extends SparkFunSuite with MLlibTestSparkContext
class LogisticRegressionSuite extends SparkFunSuite with MLlibTestSparkContext
class OneVsRestSuite extends SparkFunSuite with MLlibTestSparkContext
class RandomForestClassifierSuite extends SparkFunSuite with MLlibTestSparkContext
class RegressionEvaluatorSuite extends SparkFunSuite with MLlibTestSparkContext
class BinarizerSuite extends SparkFunSuite with MLlibTestSparkContext
class BucketizerSuite extends SparkFunSuite with MLlibTestSparkContext
class HashingTFSuite extends SparkFunSuite with MLlibTestSparkContext
class IDFSuite extends SparkFunSuite with MLlibTestSparkContext
class NormalizerSuite extends SparkFunSuite with MLlibTestSparkContext
class OneHotEncoderSuite extends SparkFunSuite with MLlibTestSparkContext
class PolynomialExpansionSuite extends SparkFunSuite with MLlibTestSparkContext
class StringIndexerSuite extends SparkFunSuite with MLlibTestSparkContext
class RegexTokenizerSuite extends SparkFunSuite with MLlibTestSparkContext
class VectorAssemblerSuite extends SparkFunSuite with MLlibTestSparkContext
class VectorIndexerSuite extends SparkFunSuite with MLlibTestSparkContext
class Word2VecSuite extends SparkFunSuite with MLlibTestSparkContext
class ParamsSuite extends SparkFunSuite
class SharedParamsSuite extends SparkFunSuite
class ALSSuite extends SparkFunSuite with MLlibTestSparkContext with Logging
class DecisionTreeRegressorSuite extends SparkFunSuite with MLlibTestSparkContext
class GBTRegressorSuite extends SparkFunSuite with MLlibTestSparkContext
class LinearRegressionSuite extends SparkFunSuite with MLlibTestSparkContext
class RandomForestRegressorSuite extends SparkFunSuite with MLlibTestSparkContext
class CrossValidatorSuite extends SparkFunSuite with MLlibTestSparkContext
class ParamGridBuilderSuite extends SparkFunSuite
class PythonMLLibAPISuite extends SparkFunSuite
class LogisticRegressionSuite extends SparkFunSuite with MLlibTestSparkContext with Matchers
class LogisticRegressionClusterSuite extends SparkFunSuite with LocalClusterSparkContext
class NaiveBayesSuite extends SparkFunSuite with MLlibTestSparkContext
class NaiveBayesClusterSuite extends SparkFunSuite with LocalClusterSparkContext
class SVMSuite extends SparkFunSuite with MLlibTestSparkContext
class SVMClusterSuite extends SparkFunSuite with LocalClusterSparkContext
class StreamingLogisticRegressionSuite extends SparkFunSuite with TestSuiteBase
class GaussianMixtureSuite extends SparkFunSuite with MLlibTestSparkContext
class KMeansSuite extends SparkFunSuite with MLlibTestSparkContext
class KMeansClusterSuite extends SparkFunSuite with LocalClusterSparkContext
class LDASuite extends SparkFunSuite with MLlibTestSparkContext
class PowerIterationClusteringSuite extends SparkFunSuite with MLlibTestSparkContext
class StreamingKMeansSuite extends SparkFunSuite with TestSuiteBase
class AreaUnderCurveSuite extends SparkFunSuite with MLlibTestSparkContext
class BinaryClassificationMetricsSuite extends SparkFunSuite with MLlibTestSparkContext
class MulticlassMetricsSuite extends SparkFunSuite with MLlibTestSparkContext
class MultilabelMetricsSuite extends SparkFunSuite with MLlibTestSparkContext
class RankingMetricsSuite extends SparkFunSuite with MLlibTestSparkContext
class RegressionMetricsSuite extends SparkFunSuite with MLlibTestSparkContext
class ChiSqSelectorSuite extends SparkFunSuite with MLlibTestSparkContext
class ElementwiseProductSuite extends SparkFunSuite with MLlibTestSparkContext
class HashingTFSuite extends SparkFunSuite with MLlibTestSparkContext
class IDFSuite extends SparkFunSuite with MLlibTestSparkContext
class NormalizerSuite extends SparkFunSuite with MLlibTestSparkContext
class PCASuite extends SparkFunSuite with MLlibTestSparkContext
class StandardScalerSuite extends SparkFunSuite with MLlibTestSparkContext
class Word2VecSuite extends SparkFunSuite with MLlibTestSparkContext
class FPGrowthSuite extends SparkFunSuite with MLlibTestSparkContext
class FPTreeSuite extends SparkFunSuite with MLlibTestSparkContext
class PeriodicGraphCheckpointerSuite extends SparkFunSuite with MLlibTestSparkContext
class BLASSuite extends SparkFunSuite
class BreezeMatrixConversionSuite extends SparkFunSuite
class BreezeVectorConversionSuite extends SparkFunSuite
class MatricesSuite extends SparkFunSuite
class VectorsSuite extends SparkFunSuite
class BlockMatrixSuite extends SparkFunSuite with MLlibTestSparkContext
class CoordinateMatrixSuite extends SparkFunSuite with MLlibTestSparkContext
class IndexedRowMatrixSuite extends SparkFunSuite with MLlibTestSparkContext
class RowMatrixSuite extends SparkFunSuite with MLlibTestSparkContext
class RowMatrixClusterSuite extends SparkFunSuite with LocalClusterSparkContext
class GradientDescentSuite extends SparkFunSuite with MLlibTestSparkContext with Matchers
class GradientDescentClusterSuite extends SparkFunSuite with LocalClusterSparkContext
class LBFGSSuite extends SparkFunSuite with MLlibTestSparkContext with Matchers
class LBFGSClusterSuite extends SparkFunSuite with LocalClusterSparkContext
class NNLSSuite extends SparkFunSuite
class BinaryClassificationPMMLModelExportSuite extends SparkFunSuite
class GeneralizedLinearPMMLModelExportSuite extends SparkFunSuite
class KMeansPMMLModelExportSuite extends SparkFunSuite
class PMMLModelExportFactorySuite extends SparkFunSuite
class RandomDataGeneratorSuite extends SparkFunSuite
class RandomRDDsSuite extends SparkFunSuite with MLlibTestSparkContext with Serializable
class MLPairRDDFunctionsSuite extends SparkFunSuite with MLlibTestSparkContext
class RDDFunctionsSuite extends SparkFunSuite with MLlibTestSparkContext
class ALSSuite extends SparkFunSuite with MLlibTestSparkContext
class MatrixFactorizationModelSuite extends SparkFunSuite with MLlibTestSparkContext
class IsotonicRegressionSuite extends SparkFunSuite with MLlibTestSparkContext with Matchers
class LabeledPointSuite extends SparkFunSuite
class LassoSuite extends SparkFunSuite with MLlibTestSparkContext
class LassoClusterSuite extends SparkFunSuite with LocalClusterSparkContext
class LinearRegressionSuite extends SparkFunSuite with MLlibTestSparkContext
class LinearRegressionClusterSuite extends SparkFunSuite with LocalClusterSparkContext
class RidgeRegressionSuite extends SparkFunSuite with MLlibTestSparkContext
class RidgeRegressionClusterSuite extends SparkFunSuite with LocalClusterSparkContext
class StreamingLinearRegressionSuite extends SparkFunSuite with TestSuiteBase
class CorrelationSuite extends SparkFunSuite with MLlibTestSparkContext
class HypothesisTestSuite extends SparkFunSuite with MLlibTestSparkContext
class KernelDensitySuite extends SparkFunSuite with MLlibTestSparkContext
class MultivariateOnlineSummarizerSuite extends SparkFunSuite
class MultivariateGaussianSuite extends SparkFunSuite with MLlibTestSparkContext
class DecisionTreeSuite extends SparkFunSuite with MLlibTestSparkContext
class GradientBoostedTreesSuite extends SparkFunSuite with MLlibTestSparkContext
class ImpuritySuite extends SparkFunSuite with MLlibTestSparkContext
class RandomForestSuite extends SparkFunSuite with MLlibTestSparkContext
class BaggedPointSuite extends SparkFunSuite with MLlibTestSparkContext
class MLUtilsSuite extends SparkFunSuite with MLlibTestSparkContext
class NumericParserSuite extends SparkFunSuite
class TestingUtilsSuite extends SparkFunSuite
class ReplSuite extends SparkFunSuite
class ReplSuite extends SparkFunSuite
class DistributionSuite extends SparkFunSuite
class ScalaReflectionSuite extends SparkFunSuite
class SqlParserSuite extends SparkFunSuite
class AnalysisSuite extends SparkFunSuite with BeforeAndAfter
class DecimalPrecisionSuite extends SparkFunSuite with BeforeAndAfter
class AttributeSetSuite extends SparkFunSuite
class ExpressionEvaluationBaseSuite extends SparkFunSuite
class UnsafeRowConverterSuite extends SparkFunSuite with Matchers
class PlanTest extends SparkFunSuite
class SameResultSuite extends SparkFunSuite
class RuleExecutorSuite extends SparkFunSuite
class TreeNodeSuite extends SparkFunSuite
class MetadataSuite extends SparkFunSuite
class DataTypeParserSuite extends SparkFunSuite
class DataTypeSuite extends SparkFunSuite
class UTF8StringSuite extends SparkFunSuite
class DecimalSuite extends SparkFunSuite with PrivateMethodTester
class DataFrameStatSuite extends SparkFunSuite
class RowSuite extends SparkFunSuite
class SQLConfSuite extends QueryTest
class SQLContextSuite extends SparkFunSuite with BeforeAndAfterAll
class ScalaReflectionRelationSuite extends SparkFunSuite
class SerializationSuite extends SparkFunSuite
class ColumnStatsSuite extends SparkFunSuite
class ColumnTypeSuite extends SparkFunSuite with Logging
class NullableColumnAccessorSuite extends SparkFunSuite
class NullableColumnBuilderSuite extends SparkFunSuite
class PartitionBatchPruningSuite extends SparkFunSuite with BeforeAndAfterAll with BeforeAndAfter
class BooleanBitSetSuite extends SparkFunSuite
class DictionaryEncodingSuite extends SparkFunSuite
class IntegralDeltaSuite extends SparkFunSuite
class RunLengthEncodingSuite extends SparkFunSuite
class PlannerSuite extends SparkFunSuite
class SparkSqlSerializer2DataTypeSuite extends SparkFunSuite
class DebuggingSuite extends SparkFunSuite
class HashedRelationSuite extends SparkFunSuite
class JDBCSuite extends SparkFunSuite with BeforeAndAfter
class JDBCWriteSuite extends SparkFunSuite with BeforeAndAfter
class ParquetSchemaSuite extends SparkFunSuite with ParquetTest
class ResolvedDataSourceSuite extends SparkFunSuite
class CliSuite extends SparkFunSuite with BeforeAndAfter with Logging
abstract class HiveThriftServer2Test extends SparkFunSuite with BeforeAndAfterAll with Logging
class HiveInspectorSuite extends SparkFunSuite with HiveInspectors
class HiveMetastoreCatalogSuite extends SparkFunSuite
class HiveQlSuite extends SparkFunSuite with BeforeAndAfterAll
class SerializationSuite extends SparkFunSuite
class VersionsSuite extends SparkFunSuite with Logging
class ConcurrentHiveSuite extends SparkFunSuite with BeforeAndAfterAll
class OrcPartitionDiscoverySuite extends QueryTest with BeforeAndAfterAll
class OrcQuerySuite extends QueryTest with BeforeAndAfterAll with OrcTest
class CommitFailureTestRelationSuite extends SparkFunSuite with SQLTestUtils
class DStreamClosureSuite extends SparkFunSuite with BeforeAndAfterAll
class DStreamScopeSuite extends SparkFunSuite with BeforeAndAfter with BeforeAndAfterAll
class StreamingContextSuite extends SparkFunSuite with BeforeAndAfter with Timeouts with Logging
trait TestSuiteBase extends SparkFunSuite with BeforeAndAfter with Logging
class InputInfoTrackerSuite extends SparkFunSuite with BeforeAndAfter
class UIUtilsSuite extends SparkFunSuite with Matchers
class RateLimitedOutputStreamSuite extends SparkFunSuite
class WriteAheadLogSuite extends SparkFunSuite with BeforeAndAfter
class ClientDistributedCacheManagerSuite extends SparkFunSuite with MockitoSugar
class ClientSuite extends SparkFunSuite with Matchers with BeforeAndAfterAll
class YarnAllocatorSuite extends SparkFunSuite with Matchers with BeforeAndAfterEach
class YarnClusterSuite extends SparkFunSuite with BeforeAndAfterAll with Matchers with Logging
class YarnSparkHadoopUtilSuite extends SparkFunSuite with Matchers with Logging

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33643/
Test FAILed.

Merged build finished. Test FAILed.

Yeah, probably best to introduce the error  / warning gradually, too, since I suspect it would cause a lot of build breaks if we merge PRs that are passing tests w/o retesting with the new build.

Merged build triggered.

Merged build started.

Test build #33646 has started for   PR 6441 at commit c43ffc4.

Test build #33646 has finished for   PR 6441 at commit c43ffc4.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33646/
Test FAILed.

Latest set of tests failed because a new test suite was merged into master in an existing test file :).
This is now fixed as of the latest commit.

By the way @yhuai I figured out why the sql.VersionsSuite was failing. See 888258162cec148133efcdb5bc53e8fe9c8787e1

Merged build triggered.

Merged build started.

Test build #33673 has started for   PR 6441 at commit 7790b6c.

Test build #33673 has finished for   PR 6441 at commit 7790b6c.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

We can easily add a scalastyle check to grep for "FunSuite".

@andrewor14 can you bring this up to date?

I will, but it's still failing a hive-thriftserver test that I'm investigating offline

This now merges with master cleanly, but it will still fail the hive-thriftserver tests until #6493 is merged.

Merged build triggered.

Merged build started.

Test build #33754 has started for   PR 6441 at commit 017c8ba.

Test build #33754 has finished for   PR 6441 at commit 017c8ba.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

@rxin I was planning to add it to run-test-jenkins after it's converted to python. IMO it shouldn't really be a scala style failure if the user doesn't extend my thing.

Merged build triggered.

Merged build started.

Alright, I just merged #6493 and rebased. The latest run should pass...

Test build #33756 has started for   PR 6441 at commit d622af7.

Merged build triggered.

Merged build started.

Test build #33758 has started for   PR 6441 at commit 879b060.

@andrewor14 why shouldn't it? The script is called lint-scala, not just style checks.

Yes, but the error message the developer gets is the same. It's a little strange from the developer's perspective: they're just extending a class, which is totally legitimate, and suddenly they get This patch fails Scala style checks.
Also, it actually won't work unless we exclude certain files, because SparkFunSuite does extend FunSuite. I just think a better place to do it would be in the PR diff.

It's really easy to exclude.
//scalastyle:off
//scalastyle:on

The problem with doing one-off stuff like this is that it is very hard to maintain. Imagine you have some place that you'd need to add FunSuite, or maybe document that includes the word "FunSuite". Since the script we wrote ourselves don't do any syntactic parsing, we will have to change the script itself to add new excludes. These scripts are not very well tested, and then they might just break (i.e. no longer checking) without us knowing.

I don't see how it's a one-off. Unlike doing it through scalastyle, my proposal actually doesn't require any explicit exclusions because it only checks the diff (i.e. future code). We check for something more specific like extends FunSuite, which is unlikely to be mentioned in a comment. I also don't anticipate tests in the future that actually extends FunSuite directly, since we want everything to go through the new class (the whole point of this patch).
By the way, I don't actually feel super strongly about this, so if you prefer we can do it through scalastyle. I just find it a little strange to do so because it's not really a style violation.

Either way let's do it outside of this patch because it's particularly prone to merge conflicts.

Test build #33758 has finished for   PR 6441 at commit 879b060.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test build #33756 timed out     for PR 6441 at commit d622af7     after a configured wait of 150m.

Merged build finished. Test FAILed.

The last tests actually passed (see commit order). I'm merging this into master. If there are follow-up fixes or comments let's address it separately. Thanks everyone.

Note to self: when we backport this later remember to also back port the two hot fixes:
8c9979337f193c72fd2f1a891909283de53777e3
a4f24123d8857656524c9138c7c067a4b1033a5e

Regarding backporting, it could be enough to start with copying {{SparkFunSuite}} into 1.3 & 1.4 branches, so that any new patches written against trunk can be applied to those branches without any rewrites being needed. You wouldn't need to patch the existing tests for that, just have new tests switch to it even in the older branches


TagUI snap page with Chrome not capturing full screen.

Hi,
I tried the command tagui samples\1_yahoo chrome
The snap page command is not able to capture full page as oppose to without the chrome option.
Is this expected?
Thanks.

Hi @RobinTYK yes that is expected. The goal of TagUI is to replicate user action on applications frontend. Thus a normal print-screen would also only capture the visible area of the webpage and not the entire webpage.
Without Chrome option, TagUI runs in the default PhantomJS mode. Since it was designed originally for test automation, it captures the full length of the webpage whether it is in the visible area or not.
Some alternatives if still want to use TagUI -

using dom step with JavaScript code to scroll down and capture separate images (eg dom window.scrollTo(500, 0))

use default mode in PhantomJS to capture the fullscreen image, but PhantomJS is an older browser engine, so it may not work correctly for websites designed and tested on Chrome

use visual automation mode to tell Chrome to export webpage as a PDF

Otherwise, there should also be other automation tools that can capture fullscreen of webpage.

Thanks for the tips!

hi, may i know how to tell chrome to export webpage as a pdf? for snap command, not a full page, but only visiable page, I want to snap a full page. thanks.

use visual automation mode to tell Chrome to export webpage as a PDF


Lifted processing of segregation queries

There seems to be an issue with the resolution of segregation queries of the
form
e.SegQuery[e.n, e.s] = (
    e.NetworkReported(e.n, e.s)
    & ~nl.exists(
        e.n2,
        (e.n2 != e.n)
        & e.NetworkReported(e.n2, e.s)
    )
)

The query is not in the unate fragment of first-order logic. But it is not
detected by the verification step in dalvi/suciu.
Although it is not part of the unate fragment, this query can be shattered
because each ground literal NetworkReported(e.n, e.s) in the resulting
conjunction is for a different network e.n.
I think we need to have a special case for this type of queries that can be
shattered in this way, which should derive a plan that looks like
∏_i{n, s}( σ_{n2 != n}( ρ_{n, s}(NR) ⋈ ρ_{n2, s}(NR) ) )

I also saw, while debugging, that the flattening step transforms the query in a
weird way.
It used to work with the WMC resolution but I think now it does not work
anymore.

@tgy what's the flattened version of the query?

The query
Query(n, s) :- SegQuery(n, s), SelectedStudy(s)

is flattened as
Query(n, s) :-
    SelectedStudy(s),
    ¬∃ fresh ( NetworkReported(fresh, s), fresh != n, NetworkReported(n, s) ),
    NetworkReported(n, s)

but I would have expected something like
Query(n, s) :-
    SelectedStudy(s),
    ¬∃ fresh ( NetworkReported(fresh, s), fresh != n ),
    NetworkReported(n, s)

Hey @tgy, I just fixed a problem in exception inheritance that didn't allow _solve_probabilistic_stratum to continue evaluating against the other probabilistic solvers. Your query still fails, but the problem should no longer be in Dalvi Suciu's implementation.

I've changed the example to make sure it's safe-range, the resolution seems to be hanging before reaching the probabilistic query evaluation step

I've changed the example to make sure it's safe-range, the resolution seems to be hanging before reaching the probabilistic query evaluation step

@tgy
Is it hanging or just that the triple cross product generates a horribly large dataset and takes lots of time?
They query was safe range before, just that the way it was rewritten into horn clauses was not what you expected but was it semantically correct?

@tgy I think we would need a bit of a more formal argument that this is a liftable case. Can you make an example with a set of 3 elements?


Vulnerability in dependancy

There is a vulnerability disclosed recently in a package this library is dependant on.
There is a PR to fix this here: https://github.com/json-schema-faker/json-schema-faker/pull/822
I am on @stoplight/prism-cli version 5.10.0
Vulnerability is disclosed here https://github.com/advisories/GHSA-pppg-cpfq-h7wr
# npm audit report

jsonpath-plus  <10.0.0
Severity: critical
JSONPath Plus Remote Code Execution (RCE) Vulnerability - https://github.com/advisories/GHSA-pppg-cpfq-h7wr
fix available via `npm audit fix --force`
Will install<EMAIL_ADDRESS>which is a breaking change
node_modules/jsonpath-plus
  json-schema-faker  0.5.0-rc1 - 0.5.0-rcv.46 || >=0.5.2
  Depends on vulnerable versions of jsonpath-plus
  node_modules/json-schema-faker
    @stoplight/prism-cli  *
    Depends on vulnerable versions of @stoplight/prism-http
    Depends on vulnerable versions of @stoplight/prism-http-server
    Depends on vulnerable versions of json-schema-faker
    node_modules/@stoplight/prism-cli
    @stoplight/prism-http  >=3.0.0-alpha.0
    Depends on vulnerable versions of json-schema-faker
    node_modules/@stoplight/prism-http
      @stoplight/prism-http-server  *
      Depends on vulnerable versions of @stoplight/prism-http
      node_modules/@stoplight/prism-http-server

5 critical severity vulnerabilities

To address all issues (including breaking changes), run:
  npm audit fix --force

To be precise the vulnerability is present for the jsonpath-plus dependancy which is a dependency of json-schema-faker library that prism is dependant on.

indeed, this vulnerability is introduced via json-schema-faker. I have checked and the latest version of json-schema-faker patches jsonpath-plus https://github.com/json-schema-faker/json-schema-faker/blob/master/package.json#L103

I have raise a PR

This should be fixed in 5.11.1 release. Thanks @bo-acc

This should be fixed in 5.11.1 release. Thanks @bo-acc

Thank you!


await Promise.all fails to resolve due a toString call inside JSX

await Promise.all fails to resolve due a toString call inside JSX
I am sorry if this doesn't end up being a TypeScript bug, I'm just not able to replicate this without React at the moment. This feels more like a TypeScript issue? So I'll let you guys decide.
🔎 Search Terms
await Promise.all toString JSX ReactNode
🕗 Version & Regression Information

This is a type checking error
Broken on 4.6.4, works with version 4.6.2
I am only able to replicate this with React 17.0.2, not react 18

⏯ Repo Link
Sorry, I have to use a repo for this. It's a bit of a setup to create the conditions for this.
https://github.com/Fish1/bughunter
💻 Code
/src/pages/HomePage.tsx
import { ReactNode } from "react";
import MyList from "../component/MyList";

function HomePage() {

  async function myUnusedFunction() {
      const getDataFetch1 = Promise.resolve(["hello", "world"])
      const getDataFetch2 = Promise.resolve([{ id: 1 }, { id: 2 }])

      const [data1, data2] = await Promise.all([
        getDataFetch1, getDataFetch2
      ]);

      const x = data2.map((data) => {
        return data.id.toString();
      });

      const y = data1.map((data) => {
        return data.toString();
      });

      return { x, y };
  }

  const myNodeArray: ReactNode[] = [

hello
,

world
,
    "hello",
    "sup",
  ]

  return (

Home Page

      <MyList columnsCurrent={myNodeArray}/>

  );
}

export default HomePage;

/src/component/MyList.tsx
import { ReactNode } from "react";

export interface ListThingProps {
  columnsCurrent: ReactNode[],
}

function MyList(props: ListThingProps) {
  const { columnsCurrent } = props;

  return (

      {
        columnsCurrent.map((column, index) => {

          /**
           * *******************************************************************
           * This variable existing will cause Promise.all() to not resolve its promises.
           * *******************************************************************
           */
          const brokenString = column?.toString();

          return (

              {/* remove {column} here to fix the Promise.all() error */}
              {column}

          )
        })
      }

  );
}

export default MyList;

output of npx tsc
src/pages/HomePage.tsx:14:23 - error TS2339: Property 'map' does not exist on type 'Promise<{ id: number; }[]>'.

14       const x = data2.map((data) => {
                         ~~~

  src/pages/HomePage.tsx:14:23
    14       const x = data2.map((data) => {
                             ~~~
    Did you forget to use 'await'?

src/pages/HomePage.tsx:14:28 - error TS7006: Parameter 'data' implicitly has an 'any' type.

14       const x = data2.map((data) => {
                              ~~~~

src/pages/HomePage.tsx:18:23 - error TS2339: Property 'map' does not exist on type 'Promise<string[]>'.

18       const y = data1.map((data) => {
                         ~~~

  src/pages/HomePage.tsx:18:23
    18       const y = data1.map((data) => {
                             ~~~
    Did you forget to use 'await'?

src/pages/HomePage.tsx:18:28 - error TS7006: Parameter 'data' implicitly has an 'any' type.

18       const y = data1.map((data) => {
                              ~~~~

Found 4 errors in the same file, starting at: src/pages/HomePage.tsx:14

🙁 Actual behavior
await Promise.all doesn't resolve the promises.
🙂 Expected behavior
I expect Promise.all() to resolve it's types correctly regardless of a variable in another file.
Strange Solutions that I have come up with

Comment out the brokenString variable in /src/component/MyList.tsx
Uncomment the FixPromiseError() function in src/pages/DummyPage.tsx
Remove {column} from inside the div in /src/component/MyList.tsx

Here is a link to the TypeScript community discord, and the thread with a lots more testing.
https://discord.com/channels/508357248330760243/1068268321998372964

Here is a demonstration of another "fix".

create a "DummyPage"
add a function that returns a promise
import it before the home page is imported

This resolves all the issues with promise.all, It seemed like typescript didn't have the type definitions of the Promise library?

All fixed :D

This error seems to be caused by the optional chaining of the NodeElement type.
The optional chain can exist, but if it has an if statement guard, it is fine. It's only an issue when the code is depending on the optional chain.
Also, I can only seem to get this error when working with the NodeElement type in react.

Another test case: the optional chaining works fine, as long as you use the variable inside the JSX return of the map. And you don't try to do other optional chaining inside the function.

create a string variable from column?.toString
call column?.toString() (with or without the if guard) (with or without the optional chaining)
put the myString variable inside the div

Test Case: setting "allowJS": false inside tsconfig.json
If you set "allowJS": false in tsconfig.json, then VSCode will not detect the error. But TSC will continue to detect it.

Test Case: Updating to React 18 fixes the issue. But I noticed the spot where they changed the ReactFragment type, and reverted it back to what was in React 17. This caused to issue to reappear.
@types/react/index.d.ts

Here I commented out the React18 ReactFragment, and brought back the React17 ReactFragment. And the issue shows up.
@types/react/index.d.ts

I then deleted the {} type from the Fragment, and the issue is resolved.

Minimal repro I have so far:
import {} from "../component/MyList";

async function myUnusedFunction() {
  const getDataFetch1 = Promise.resolve(["hello", "world"])
  const [data1] = await Promise.all([getDataFetch1]);
  const y = data1.map((data) => {
    return data.toString();
  });
  return { y };
}

import { ReactNode } from "react";

function MyList() {
  [null as ReactNode].map(column => {
    column?.toLocaleString; // <-- key line
    const aa = column;
  });
}

Trying to simplify further but this is very, very delicate

OK, so it's just these two files
import { ReactNode } from "react";

function MyList() {
  [null as ReactNode].map(column => {
    column?.toLocaleString; // <-- key line
    const aa = column; // <-- also key line
  });
}

async function myUnusedFunction() {
  const getDataFetch1 = Promise.resolve(["hello", "world"])
  const [data1] = await Promise.all([
    getDataFetch1
  ]);
  data1.map(() => { });
}

listed in that order in tsconfig, with these dependencies:
  "dependencies": {
    "react": "17.0.2",
    "react-dom": "17.0.2"
  },
  "devDependencies": {
    "@types/react": "17.0.53",
    "@types/react-dom": "17.0.18",
    "@vitejs/plugin-react": "2.2.0",
    "typescript": "4.9.4",
    "vite": "3.2.5"
  }

I'm incredibly curious what's going on, but would really want the react dependency stubbed out into something that still repros this before investigating further. This bug, whatever it is, is very hard to hit.

@RyanCavanaugh Thank you so much! I think I was able to remove the React dependency. It is pushed to the "minimal" branch of my GitHub repo.
Branch: https://github.com/Fish1/bughunter/tree/minimal
/main.tsx
async function myUnusedFunction() {
  const fetch1 = Promise.resolve(['hello', 'world']);
  const [data1] = await Promise.all([fetch1]);
  const y = data1.map((data) => {
    return data.toString();
  });
  return { y };
}

export default myUnusedFunction();

/MyList.tsx
type myType = {} | null | undefined;

function MyList() {
  [null as myType].map(column => {
    column?.toLocaleString;
    const aa = column;
  });
}

export default MyList;

Was able to take reduce the issue a little bit more. We can simply remove the map from the MyList file.
/main.ts
async function myUnusedFunction() {
  const fetch1 = Promise.resolve(['hello', 'world']);
  const [data1] = await Promise.all([fetch1]);
  data1.length;
}

/MyType.ts
type MyType = {} | null | undefined;

const myVar: MyType = null as MyType;

// you need the following two lines together, to make it work
myVar?.toLocaleString;
const x = myVar;

I also went and reset the tsconfig to what is produced by TSC init.
{
  "compilerOptions": {
    "target": "es2016",
    "module": "commonjs",
    "esModuleInterop": true,
    "forceConsistentCasingInFileNames": true,
    "strict": true,
    "skipLibCheck": true,
    "noEmit": true
  }
}

Test Case: It appears to be that what matters is two expressions  of myVar being used, where the first is a conditional chain.

Was able to reproduce it in a single file, and have it in the playground.
type MyType = {} | null | undefined;

const myVar: MyType = null as MyType;

myVar?.toLocaleString;
myVar;

async function myUnusedFunction() {
  const fetch1 = Promise.resolve(['hello', 'world']);
  const [data1] = await Promise.all([fetch1]);
  data1.length;
}

https://www.typescriptlang.org/play?#code/C4TwDgpgBAsiAq5oF4oG8C+UA+UB2ArgDZE5QF4AmEAZgJZ4SUDcAUKwMYD2eAzsFAC2IAGoBDAE4AuWAiRRUhElDG9ZiSG1bDxEgPwA6YFwAyXDmKIQAysAkMA5mx2StqkHg5QaFDsDo8QiAAqoS8TABivv48ABQAlOisUFDcfAI0EMAcABYAjApQAAoSXIJ04QYSELxcRABuELEA2gDkORAkXK0ANFCtAO5cEkSUrQC68WwpafxQzZRiwGJ544ViA2J0AiVlFRAGlkQtmdn5k9NQi8t5BlZ4DsA5bBisQA

Since this reproduces, I did a bisect which points to #49119.

The test, FWIW:
// @strict: true
// @target: esnext
// @lib: esnext

type MyType = {} | null | undefined;

const myVar: MyType = null as MyType;

myVar?.toLocaleString;
myVar;

async function myUnusedFunction() {
    const fetch1 = Promise.resolve(['hello', 'world']);
    const [data1] = await Promise.all([fetch1]);
    data1.length;
}

@Fish1 big thanks for helping get to a short repro and @Andarist for the fast fix!

Amazing work! Thanks everyone!

It was so bizarre that I couldn't resist debugging this 😅


More friendly messages for non-string

(Originally opened at https://github.com/sindresorhus/parse-json/issues/16)
When I passed undefined, the error was
TypeError: Cannot read property 'length' of undefined

For NaN, Infinity, new Set() etc,
TypeError: txt.slice is not a function

The cause was assuming the passed value is a string, so I added type check. Throws message with the type and the value converted to string if the value is not string.

After some discussion on https://github.com/sindresorhus/parse-json/issues/16, I updated error handling.

If txt is an empty array [], it special-cases and says Cannot parse an empty array, since String([]) is an empty string and would be confusing.
Other non-strings are converted to string with String().
Throws TypeError

Also added a bunch of test codes to increase coverage to 100%.

Merged and released as v1.0.2. Thanks for the contrib!


az: error: unrecognized arguments: -e AzureChinaCloud

CLI Version: 2.0.0
OS Type:  Win7 x64
Installation via:  pip (python 3.5.2)
Environment: Azure China Cloud
Description:
az login -u {username} -e AzureChinaCloud command doesn't allow to login but error throws out

az: error: unrecognized arguments: -e AzureChinaCloud

Steps to reproduce:

After installed python 3.5 and then installed azure-cli 2.0 via pip install --user azure-cli
Check az --version output: azure-cli (2.0.0)
Then run az login -u {username} -e AzureChinaCloud

Error stack trace:
..\AppData\Roaming\Python\Python35\Scripts>az login -u {username} -e AzureChinaCloud --verbose
az: error: unrecognized arguments: -e AzureChinaCloud
usage: az [-h] [--output {json,tsv,table,jsonc}] [--verbose] [--debug]
[--query JMESPATH]          {network,iot,storage,ad,acs,batch,appservice,snapshot,vm,disk,tag,role,keyvault,sql,vmss,documentdb,group,policy,redis,component,login,resou
rce,feature,image,lock,logout,cloud,account,container,provider,configure,feedback}
...
Original issue file by @ginocui over here https://github.com/Azure/azure-xplat-cli/issues/3531

$ az cloud set -n AzureChinaCloud
$ az login -u {username}

@derekbekoe Thanks for your advice
It works to me for switching cloud to china area with the command. However, the second normal login command doesn't work well, instead, throw an error

Get Token request returned http error: 400 and server response: {"error":"invalid_grant","error_description":"AADSTS50034: To sign into this applicati
on the account must be added to the [cloud account] directory.\r\nTrace ID: b65e56d1-4675-44d0-a29e-3cc6625f7d37\r\nCorrelation ID: 38066
dfd-6e36-4224-9d87-17ec14fd6835\r\nTimestamp: 2017-03-13 06:17:01Z","error_codes":[50034],"timestamp":"2017-03-13 06:17:01Z","trace_id":"b65e56d1-4675
-44d0-a29e-3cc6625f7d37","correlation_id":"38066dfd-6e36-4224-9d87-17ec14fd6835"}

No idea what's the root cause. Will contact the local azure support for clarification. Any updates will post here.

After consult with local azure support team, Azure CLI 2.0 (generally available release) doesn't work well to Azure China due to the incompatibility issues. The issue will be resolved in future RC and stable release. I was advised that Azure CLI 0.10.x current stable version azure-xplat-cli
@amarzavery  please help to close this issue.


Autofill username and password don't cause labels to float on chrome

Hello, thanks for a great library!
Unfortunately on Chrome when I have w-input for email and password, the autofill values don't cause the labels to float so it looks awful.  To fix it, we can poll to see if element.matches(":-webkit-autofill") is true.  If it is, we can then go ahead and raise the label.  Obviously this shouldn't happen for all items, but I think there should be a prop that is called detect-autofill or something like that which will do a setInterval for a few seconds to make sure to raise the labels once it gets auto filled.

Hi @turbobuilt,
Sorry for the delay.
Thanks for the suggestion and piece of code to use. 👍
But could you give a reproduction link or your piece of code, because when I use the autofill on Chrome it looks good on my end: https://codepen.io/antoniandre/pen/PoJmoZJ?editors=1000
In addition, I already have this piece of code to move the label up:
https://github.com/antoniandre/wave-ui/commit/884fb96554b615bff6eb290689c098511bc1b17e#diff-a369dc99eb76a8e49e8b82c3aa5ff70bf6ac01aa39cb48916b3687cb33899930R340
Let me know if this is still happening :)

Hi @antoniandre, that reproduction link you gave doesn’t cause the issue for some reason because the username/password isn’t pre-filled. But I noticed it only happens when I load the login page of my app directly, first thing. The moment the page loads, chrome auto fills login information. As soon as I click anywhere in the page, the labels raise themselves. But for some reason it waits for first interaction in order to apply that css style that should raise the label. I don’t understand why. Perhaps it’s a chrome bug. But the code pen login doesn’t get pre filled, so it doesn’t show the issue. I haven’t had time to make a new repo that can demonstrate it but I will try to do it soon. Thanks for your help and your great work on this library. It’s da bomb!
Sent from my iPhone

On Dec 16, 2021, at 2:39 PM, Antoni @.***> wrote:

Hi @turbobuilt,
Sorry for the delay.
Thanks for the suggestion and piece of code to use. 👍
But could you give a reproduction link or your piece of code, because when I use the autofill on Chrome it looks good on my end: https://codepen.io/antoniandre/pen/PoJmoZJ?editors=1000
In addition, I already have this piece of code to move the label up:
884fb96#diff-a369dc99eb76a8e49e8b82c3aa5ff70bf6ac01aa39cb48916b3687cb33899930R340
Let me know if this is still happening :)
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you were mentioned.

Thanks for the feedback :)
No worries, I will wait for your repro, as I couldn't reproduce even with the autofill on page load.
Let me know, so I can investigate then!

Hi @turbobuilt,
I found a way to reproduce the issue on a https domain.
You probably had this happening on Chrome: it worked on Firefox, and Safari always prompts you before autofilling.
I fixed the issue using your piece of code. 👍
The w-input will be doing the detection by itself, you don't need a prop for that.
Could you confirm it's fixed on your end in version 1.45.13?
Cheers!

Hi @antoniandre I can't test it out because I'm on v2x, and because the project I'm on is not in a state to be deployed right now. Thanks for fixing the bug. It was so clever to figure out that it happens only on https. If I have a problem I will let you know. Thanks so much for the hard work.

Hey @turbobuilt, I also released this fix on version 2.29.0 yesterday if you're interested. :)
Cheers!