Benchmarks for Titan Embeddings

Hello,
Please forgive me if I'm being ignorant. I'd like to ask if there are any evaluations done for AWS Bedrock Titan Embedding model. If not, how can I run the benchmark myself if assuming I have access. The Readme contains loading model with Sentence Transformer and I could find any info on using external model. Any hint/help would be much appreciated.

Would be amazing if you could run it & add it to the leaderboard.
Below are some scripts for running APIs that may help for your reference

Sionic

https://huggingface.co/sionic-ai/sionic-ai-v1/blob/main/mteb_evaluate.py
https://huggingface.co/sionic-ai/sionic-ai-v1/blob/main/model_api.py

OpenAIV2:

https://github.com/embeddings-benchmark/mtebscripts/blob/main/run_array_openaiv2.py

I did some dirty hack to openai code in above reference link to caluclate one data set and got result below... I'm not sure but I'm assuming it is worse than e5-large-v2
I've difficulties running for longer periods (due to short ttl of assume-role)... I'll see what can I do
code changes:
boto3_bedrock = bedrock.get_bedrock_client(
    assumed_role=os.environ.get("BEDROCK_ASSUME_ROLE", None),
    region=os.environ.get("AWS_DEFAULT_REGION", None)
)

from langchain.embeddings import BedrockEmbeddings
from langchain.llms.bedrock import Bedrock

bedrock_embeddings = BedrockEmbeddings(model_id="amazon.titan-embed-text-v1", client=boto3_bedrock)

out = [[]] * len(batch)
                if all_tokens:
                    response = np.array(bedrock_embeddings.embed_documents(all_tokens))
                    # May want to sleep here to avoid getting too many requests error
                    # time.sleep(1)
                    assert len(response) == len(
                        all_tokens
                    ), f"Sent {len(all_tokens)}, got {len(response['data'])}"

                    idx = 0
                    for data in response:
                        embedding = data
                        out[idx] = embedding
                        idx += 1

                fin_embeddings.extend(out)

SciFact results:
{
  "dataset_revision": null,
  "mteb_dataset_name": "SciFact",
  "mteb_version": "1.1.1",
  "test": {
    "evaluation_time": 996.91,
    "map_at_1": 56.761,
    "map_at_10": 68.491,
    "map_at_100": 69.049,
    "map_at_1000": 69.06,
    "map_at_3": 65.385,
    "map_at_5": 67.549,
    "mrr_at_1": 59.667,
    "mrr_at_10": 69.37,
    "mrr_at_100": 69.832,
    "mrr_at_1000": 69.842,
    "mrr_at_3": 67.333,
    "mrr_at_5": 68.617,
    "ndcg_at_1": 59.667,
    "ndcg_at_10": 73.5,
    "ndcg_at_100": 75.757,
    "ndcg_at_1000": 76.041,
    "ndcg_at_3": 68.558,
    "ndcg_at_5": 71.38,
    "precision_at_1": 59.667,
    "precision_at_10": 10,
    "precision_at_100": 1.107,
    "precision_at_1000": 0.113,
    "precision_at_3": 27.222,
    "precision_at_5": 18.467,
    "recall_at_1": 56.761,
    "recall_at_10": 87.933,
    "recall_at_100": 97.833,
    "recall_at_1000": 1.0,
    "recall_at_3": 74.756,
    "recall_at_5": 81.467
  }
}

Nice that's strong performance; Need to run more datasets to get a comprehensive view - ideally run all of them

This issue seem to have gotten stale so will close it


add deprecated comment for cancelBubble

according to DOM spec cancelBubble is a legacy alias of
.stopPropagation()

Fixes #

You do realize that you're modifying files that are automatically generated, right? That's why they have the word "generated" in the filename.


Run go test -v in virtcontainers directory get error

Description of problem
kata-version: 1.7
Since I want to run all testcases in virtcontainers directory, so I execute the following the command:
# cd virtcontainers
# make
# make install //install some mock binary files
# go test -v
......
=== RUN   TestCalculateSandboxMem/3-mix-constraints
=== RUN   TestCalculateSandboxMem/3-constrained
--- PASS: TestCalculateSandboxMem (0.00s)
    --- PASS: TestCalculateSandboxMem/1-unconstrained (0.00s)
    --- PASS: TestCalculateSandboxMem/2-unconstrained (0.00s)
    --- PASS: TestCalculateSandboxMem/1-constrained (0.00s)
    --- PASS: TestCalculateSandboxMem/2-constrained (0.00s)
    --- PASS: TestCalculateSandboxMem/3-mix-constraints (0.00s)
    --- PASS: TestCalculateSandboxMem/3-constrained (0.00s)
=== RUN   TestCreateSandboxEmptyID
--- PASS: TestCreateSandboxEmptyID (0.00s)
=== RUN   TestSandboxStateReadyRunning
--- PASS: TestSandboxStateReadyRunning (0.00s)
=== RUN   TestSandboxStateRunningPaused
--- PASS: TestSandboxStateRunningPaused (0.00s)
=== RUN   TestSandboxStatePausedRunning
--- PASS: TestSandboxStatePausedRunning (0.00s)
=== RUN   TestSandboxStatePausedStopped
--- PASS: TestSandboxStatePausedStopped (0.00s)
=== RUN   TestSandboxStateRunningStopped
--- PASS: TestSandboxStateRunningStopped (0.00s)
=== RUN   TestSandboxStateReadyPaused
ERRO[0001] Unable to launch /tmp/vc-tmp-526112270/hypervisor: fork/exec /tmp/vc-tmp-526112270/hypervisor: permission denied  source=virtcontainers subsystem=qmp
ERRO[0001]                                               source=virtcontainers subsystem=qmp
ok  	github.com/kata-containers/runtime/virtcontainers	1.561s

And then I execute the TestSandboxStateReadyPaused testcase alone, however it passes:
go test -v -run TestSandboxStateReadyPaused
INFO: Creating virtcontainers test directory /tmp/vc-tmp-785259853
=== RUN   TestSandboxStateReadyPaused
--- PASS: TestSandboxStateReadyPaused (0.00s)
PASS
ok  	github.com/kata-containers/runtime/virtcontainers	0.042s

I want to know what's wrong with it?
Expected result
Run go test -v in virtcontainers dir will not get error info.
Actual result
Run go test -v in virtcontainers dir get the above error info.

Do you modify the code, I also get same error.

I'll tal at this...

@Ace-Tang I don't modify the code, just checkout kata-runtime code to 1.7 tag.


loss: nan

Hey,
Good work. However maybe you're aware, with default hyperparameter settings, loss: nan.

I get nan too with default hyperparameter. Would you mind telling me what parameters you choose?

I will try to take a look into it after ma vacation

Not perfect but LGTM:
Args: Namespace(batchsize=128, cuda=True, epoch=3, model='', no_cuda=False)
Train Epoch: 1 [0/108400 (0%)]	Loss: 0.224497	Took: 0.52
Train Epoch: 1 [16384/108400 (15%)]	Loss: 0.089757	Took: 22.93
Train Epoch: 1 [32768/108400 (30%)]	Loss: 0.061219	Took: 22.98
Train Epoch: 1 [49152/108400 (45%)]	Loss: 0.069422	Took: 25.06
Train Epoch: 1 [65536/108400 (60%)]	Loss: 0.055707	Took: 25.43
Train Epoch: 1 [81920/108400 (76%)]	Loss: 0.051833	Took: 25.84
Train Epoch: 1 [98304/108400 (91%)]	Loss: 0.054869	Took: 26.29
Train epoch: 1 	Took:165.37
Train Epoch: 2 [0/108400 (0%)]	Loss: 0.042918	Took: 0.23
Train Epoch: 2 [16384/108400 (15%)]	Loss: 0.034205	Took: 26.40
Train Epoch: 2 [32768/108400 (30%)]	Loss: 0.038130	Took: 26.42
Train Epoch: 2 [49152/108400 (45%)]	Loss: 0.036047	Took: 27.43
Train Epoch: 2 [65536/108400 (60%)]	Loss: 0.035470	Took: 27.30
Train Epoch: 2 [81920/108400 (76%)]	Loss: 0.033549	Took: 27.22
Train Epoch: 2 [98304/108400 (91%)]	Loss: 0.044540	Took: 27.37
Train epoch: 2 	Took:179.39
Train Epoch: 3 [0/108400 (0%)]	Loss: 0.028087	Took: 0.23
Train Epoch: 3 [16384/108400 (15%)]	Loss: 0.031086	Took: 27.32
Train Epoch: 3 [32768/108400 (30%)]	Loss: 0.038790	Took: 27.39
Train Epoch: 3 [49152/108400 (45%)]	Loss: 0.032834	Took: 27.41
Train Epoch: 3 [65536/108400 (60%)]	Loss: 0.038789	Took: 27.40
Train Epoch: 3 [81920/108400 (76%)]	Loss: 0.028260	Took: 27.40
Train Epoch: 3 [98304/108400 (91%)]	Loss: 0.032505	Took: 27.31
Train epoch: 3 	Took:181.51

I get nan too with default hyperparameter...

cant reproduce sorry ...

Using python3.5 will solve the problem.
I got nans when I was using python2.7.
I think there may be some compatibility issues in the code.

@Peratham thanks i never tried python2 for that project my current setup is:
Python 3.5.3 (default, Jan 19 2017, 14:11:04)
[GCC 6.3.0 20170118] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import torch
>>> torch.__version__
'0.2.0+47f999b'

I am building pytorch by my own from master as i have  a cuda 2.0 nvidia card.
...
01:00.0 VGA compatible controller: NVIDIA Corporation GF108M [NVS 5400M] (rev a1)
...

Build instructions:
$ cd pytorch
$ virtualenv env3
$ sudo ln -s /usr/lib/x86_64-linux-gnu/libcudart.so* /usr/lib64/
$ rm -rf torch/lib/build torch/lib/tmp_install
$ env3/bin/python setup.py clean
$ NO_DISTRIBUTED=1 CC=/usr/bin/gcc-4.9 LD_LIBRARY_PATH=torch:/usr/lib/x86_64-linux-gnu/ TORCH_CUDA_ARCH_LIST="2.0 3.0 3.5 5.2 6.0 6.1+PTX" env3/bin/python setup.py bdist_wheel
$ env3/bin/pip install dist/torch*.whl

I tried adding a dot to 255 -> 255. at lines 47-47 and 59-60 solves the problem.
Just an integer division compatibility, I guess.
http://sebastianraschka.com/Articles/2014_python_2_3_key_diff.html#integer-division


Can we get auto suggest feature on initialized variables?

r. should show auto suggest Find, FindAll etc.?
r, _ := regexp.Compile(`\d+`)
r.   // This should auto-suggest Find, FindAll

@sameerr25 hi. Current autocomplete suggestion is pretty dumb. Basically it's possible only suggest package names and package functions.
There is a plan to adapt gopls (or take some parts of it) to run inside the editor in the future.


kiss 102 edits

Adding the KISS AVC MIP 102c2 edits

[ ] MIP 101
[ ] MIP 106
[ ] MIP 113

Thank you for posting this PR.
We have separated the changes into PRs for MIP102c2-SP25 (https://github.com/makerdao/mips/pull/1054) and MIP102c2-SP26 (https://github.com/makerdao/mips/pull/1055) so that they may be polled and merged separately. We will close this PR to prevent any confusion.


mgmt/mcumgr: Provide smp_transport_register to replace smp_transport_init

Is your enhancement proposal related to a problem? Please describe.
Currently SMP transport is added, by transport backend, with call to smp_transport_init that takes a lot of parameters, first of which is
pointer to struct smp_transport *smpt and the others are callbacks:
https://github.com/zephyrproject-rtos/zephyr/blob/928e5bbcf08ccfe75f264d407e16fb1c7e82846e/include/zephyr/mgmt/mcumgr/transport/smp.h#L160-L165
All the function does is assign the provided callbacks to smpt object and then call some k_work initialization.
This means that each time a new callback is added to smp_transport, it is required to modify the smp_transport_init definition, just follow the previous way of "doing things".
Describe the solution you'd like
smp_transport_register function that would take only single smp_transport object pointer, which would be pre-initialized by caller, in similar way Flash API does with flash driver operations.
static struct smp_transport smp_bt {
  // ... all callbacks assigned here;
};
ret = smp_transport_register(&smp_bt);
// some possible error processing?

It may also be desired to change struct smp_transport to be divided to callback section (read-only), Zephyr transport internal section (k_work stuff, re-assembly - these are r/w), and transport specific section (r/w pointer).
For example:
struct _smp_transport_internal {
  struct k_work work;
  /* FIFO containing incoming requests to be processed. */
  struct k_fifo fifo;
#ifdef CONFIG_MCUMGR_TRANSPORT_REASSEMBLY
	/* Packet reassembly internal data, API access only */
	struct {
		struct net_buf *current;	/* net_buf used for reassembly */
		uint16_t expected;		/* expected bytes to come */
	} __reassembly;
#endif
};

struct smp_transport {
  smp_transport_out_fn output;
  smp_transport_get_mtu_fn get_mtu;
  smp_transport_ud_copy_fn ud_copy;
  smp_transport_ud_free_fn ud_free;
  smp_transport_query_valid_check_fn query_valid_check;
#define CONFIG_MCUMGR_TRANSPORT_HAS_ANY_THIS_OPTIONAL_CALLBACK
  // Will this be hard to do with macros?
  smp_transport_some_optional_callback optional;
#endif
  struct  _smp_transport_internal *__sys;
#ifdef CONFIG_MCUMGR_TRANSPORT_HAS_ANY_PRIVATE_DATA
  void * transport_private;
#endif
};

Above definitions will allow to have smp_transport object pointer constant: smp_transport_register(const smp_transport smpt *),
but may require providing macros to support users on defining smp_transport objects for their transport.
Because transport_private is left for transport to be defined, this allows transport to define independent instances of transport with own context.
Describe alternatives you've considered
Leaving the smp_transport_init as is.
Additional context
Example of has BT transport is registered:
https://github.com/zephyrproject-rtos/zephyr/blob/928e5bbcf08ccfe75f264d407e16fb1c7e82846e/subsys/mgmt/mcumgr/transport/src/smp_bt.c#L88
https://github.com/zephyrproject-rtos/zephyr/blob/928e5bbcf08ccfe75f264d407e16fb1c7e82846e/subsys/mgmt/mcumgr/transport/src/smp_bt.c#L656-L658

FYI @nordicjm


ENS only working on mainnet.

Description
Seems like ENS name resolution only works on miannet.  I tried to use an ENS name in Polygon and GBC safes and it didn't resolve the address, but it worked fine on a safe in mainnet.

Hi Nico, thanks for the report, we'll check! :)

I've checked and it's enabled only on Mainnet and Rinkeby atm. It's toggled for each chain separately in a remote config.
I assume you know/remember this, but if your ENS name is deployed on Mainnet, it won't and shouldn't look it up on Polygon. The ENS name has to be deployed on Polygon.
Do you have a Polygon and a GBC ENS names for us to test?

mmm... I see, as far as I understand and what I've seen in other protocols they use the resolution from mainnet.  I assume it's because for EOAs you control the same addresses on all the L2 or sidechains, so if you register the sameName.eth in different chains pointing to different addresses, it would be a mess.
Polygon has Unstoppable Domain as an equivalent of ENS, but they don't support .eth.
This is an example, 1inch allows using ENS resolution from mainnet when you are connected to Optimism.

As the Mintermute/Optimism incident has shown, it's not a good idea to assume the same address exists on all chains. So we're not likely to resolve mainnet addresses on other chains.
Unstoppable domains are a bit different, as they are deployed to Polygon but are resolved using a custom API to a mainnet address. And they are also enabled only on mainnet atm.

Gonna close the issue for now. Open to further discussion if you have more ideas.

sounds good, an alternative to prevent the same problem that happened to Wintermute is to allow using ENS in different chains only for EOA.

We discussed it a bit more, and realized just checking if an address is a contract (using getCode) doesn't necessarily mean it's an EoA. It could be just not deployed on this network but be a contract on another network.
So I'm skeptical still.

but if you check on mainnet and you detect is an EOA you can infer the same address is going to be an EOA for any L2, right?
It might not be the case if you can infer the address a contract is going to have before deploying it but what are the odds of registering an ENS domain before deploying it?

True, those are valid assumptions. 👍


Fails on the build-deploy

Hey man, thanks for your example. Having some trouble trying to apply this to an org and private repo.
The login works, but it fails for me at the build-and-deploy step with 401 unauthorized

Thanks for the report. When I get a second I'll try it on a private fork. I know there are some bits of magic for private forks and whatnot.

Point of clarification is the 401 for Hub or GHCR?

GHCR

Sorry about the delay. I think that we would have better luck moving this to the community slack. http://dockr.ly/slack #github-actions


Added sbomqs used for sbom quality scoring

Added sbomqs to the list of sbom consumption tooling.

Thank you @ivanayov.


How to use the television?

How do i use the television? I want to be able to switch inputs and turn it on and off with an command.

Good question!
The characteristics are defined in
/usr/local/lib/node_modules/homebridge/node_modules/hap-nodejs/lib/gen/
HomeKitTypes-Television.js
How you would put this into a script to control an actual TV, is beyond
me.There are other Homebridge modules that can be used to control specific
models. they could be combined with scripts, I assume. My Sony has this
capability, but IOS or Eve don't support it either.  putting it all
together would not be simple, but Cmd4 does now support the characteristics
for you to try.
ttfn,
John Talbot
On Wed, Jun 5, 2019 at 4:19 PM Torac2<EMAIL_ADDRESS>wrote:

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/ztalbot2000/homebridge-cmd4/issues/26?email_source=notifications&email_token=ABSBCXZN6E6OQ4HL5HCQ4X3PZANU7A5CNFSM4HUGCACKYY3PNVWWK3TUL52HS4DFUVEXG43VMWVGG33NNVSW45C7NFSM4GX3TQBQ,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABSBCX7QZA2ORVQK7LDFCVTPZANU7ANCNFSM4HUGCACA
.

Closed based on previous advice given.


chore: return correct err

Overview
Resolves item 7 on https://github.com/celestiaorg/celestia-node/issues/2176
Checklist

[ ] New and updated code has appropriate documentation
[ ] New and updated code has new and/or updated testing
[ ] Required CI checks are passing
[ ] Visual proof for any user facing features like CLI or documentation updates
[ ] Linked issues closed with keywords

Codecov Report

Merging #2177 (0371e52) into main (7f556f0) will decrease coverage by 0.15%.
The diff coverage is 0.00%.

@@            Coverage Diff             @@
##             main    #2177      +/-   ##
==========================================
- Coverage   56.04%   55.89%   -0.15%
==========================================
  Files         215      215
  Lines       13918    13918
==========================================
- Hits         7800     7780      -20
- Misses       5340     5359      +19
- Partials      778      779       +1

Impacted Files
Coverage Δ

share/p2p/shrexeds/client.go
64.00% <0.00%> (ø)

... and 4 files with indirect coverage changes

It's a fix not a chore though


I'm

🚀 Enhancement Request
Is your enhancement request related to a problem? Please describe.

Describe the solution you'd like

Describe alternatives you've considered

Additional context

🚀 Enhancement Request
Is your enhancement request related to a problem? Please describe.
Describe the solution you'd like
Describe alternatives you've considered
Additional context


How to run client without Grunt serve?

Hello, first off this app is a lifesaver.  I have been able to rapidly build out my own app and have been able to do with very little problems.  I am at the point where I am trying to deploy this app to another server, but am completely stuck.  I can run "grunt serve" fine, and the app will run, but what I need is to serve the app without grunt.  This app will be deployed to a windows server machine and I need to be able to install the app as service.  I can successfully do this with the api portion and navigate to /explorer/ or just /api/ and things work.  However, when trying to navigate to the client, the whole thing falls apart.  Any ideas on how to get the client to run without needing to run grunt serve (grunt build is ok as it can run once and be left alone)
Thanks in advance for your help

Hey...can you help me getting ramped up to this tool for building app...i need to as well build apps but am stucked and documentation provided is not enough for a novice like me. A quick steps on how to define my database, models and app will be very useful

This issue is created for the v0.x version of the project, which is no longer support nor maintained as of January 16th 2017. I'm therefore closing this issue.
All development effort will be put in the new version of the project that is named Colmena CMS.


Fix URL error on new versions of Django

The Django versions lower than 1.11 has the attribute app_name as a function argument, but recent versions of Django doesn't include the parameter, which causes the error:
Specifying a namespace in include() without providing an app_name is not supported

When the Django SAML 2 Pro Auth URLs are set in the project.

released via 0.0.11


Crashes when setting 60fps using setFrameRate: in GPUImageVideoCamera

On the iPhone 5 and later models, the camera can capture at 1280x720 and 60 fps. However, this cannot be set using the method setFrameRate: in the GPUImageVideoCamera class. I found that only a max value of 30 can be used with the setFrameRate:. When you use 60 with setFrameRate:, the application crashes at line 547 of GPUImageVideoCamera:
[_inputCamera setActiveVideoMinFrameDuration:CMTimeMake(1, _frameRate)];

I have been using a workaround to achieve 1280x720 and 60fps with GPUImageVideoCamera. Below is the code that I have been using:
GPUImageVideoCamera *videoCamera = [[GPUImageVideoCamera alloc] initWithSessionPreset:AVCaptureSessionPreset1280x720 cameraPosition:AVCaptureDevicePositionBack];
// videoCamera.frameRate = 60; /* CANNOT be set this way */

/* This is where 60 fps is set instead */
AVCaptureDevice *inputCamera = videoCamera.inputCamera;
for (AVCaptureDeviceFormat *videoFormat in [inputCamera formats]) {
    CMFormatDescriptionRef videoFormatDescriptionRef = videoFormat.formatDescription;
    Float64 maxFrameRate = ((AVFrameRateRange *) [videoFormat.videoSupportedFrameRateRanges objectAtIndex:0]).maxFrameRate;

    if (maxFrameRate == 60 && CMFormatDescriptionGetMediaSubType(videoFormatDescriptionRef) == kCVPixelFormatType_420YpCbCr8BiPlanarFullRange) {
        if ([inputCamera lockForConfiguration:nil]) {
            inputCamera.activeFormat = videoFormat;
            [inputCamera setActiveVideoMinFrameDuration:CMTimeMake(10, 600)];
            [inputCamera setActiveVideoMaxFrameDuration:CMTimeMake(10, 600)];
            [inputCamera unlockForConfiguration];
        }
    }
}

The main difference between this method of setting the frame rate and the one that is used in setFrameRate: is that my workaround reconfigures the  AVCaptureDevice instance of the video camera by changing its active format to one that supports 60 fps.
To achieve 1280x720 and 60 fps in GPUImageVideoCamera, I see 2 possible solutions:
1.) Use my implementation of iterating through formats on the AVCaptureDevice of GPUImageVideoCamera.
2.) Create a new initializer for GPUImageVideoCamera called initWithSessionPreset:cameraPosition:frameRate: with a default value of 30 that would be passed in through the original initializer while still using the solution I described above.
Brad, if you think my solution will work, I can modify the GPUImageVideoCamera class to support this.
Thank you.

@ngelo  I got same problem. Did you find any solutions?

@sjtujulian I was able to get the frame rate changes working by subclassing GPUImageVideoCamera and using the following implementation for setFrameRate::
- (void)setFrameRate:(int32_t)frameRate
{
    _frameRate = frameRate;

    // To avoid the video camera freaking out, use the superclass's method of
    // setting the frame rate.
    //
    // TODO: Implement this myself without the superclass.
    if (frameRate == 30) {
        [super setFrameRate:frameRate];
        return;
    }

    AVCaptureDevice *videoDevice = self.inputCamera;
    for(AVCaptureDeviceFormat *vFormat in [videoDevice formats] ) {
        CMFormatDescriptionRef description= vFormat.formatDescription;
        float maxRate = ((AVFrameRateRange*) [vFormat.videoSupportedFrameRateRanges objectAtIndex:0]).maxFrameRate;
        if (maxRate > frameRate - 1 &&
           CMFormatDescriptionGetMediaSubType(description)==kCVPixelFormatType_420YpCbCr8BiPlanarFullRange) {
            if ([videoDevice lockForConfiguration:nil]) {
                videoDevice.activeFormat = vFormat;
                [videoDevice setActiveVideoMinFrameDuration:CMTimeMake(10, frameRate * 10)];
                [videoDevice setActiveVideoMaxFrameDuration:CMTimeMake(10, frameRate * 10)];
                [videoDevice unlockForConfiguration];
                break;
            }
        }
    }

    [self resetBenchmarkAverage];
}

As you can see I didn't completely finish it as noted with the TODO comment. I'm not sure if this is be best way to do it, but it seems to work for me. Let me know if it fixes your problem.

Apple provides code for this here https://developer.apple.com/documentation/avfoundation/avcapturedevice
+ (void)configureCamera:(AVCaptureDevice *)device forFrameRate:(int)frameRate
{
    AVCaptureDeviceFormat *bestFormat = nil;
    AVFrameRateRange *bestFrameRateRange = nil;
    for ( AVCaptureDeviceFormat *format in [device formats] ) {
        for ( AVFrameRateRange *range in format.videoSupportedFrameRateRanges ) {
            //NSLog(@"Format %@",format);
            if ( range.maxFrameRate == frameRate ) {
                bestFormat = format;
                bestFrameRateRange = range;
            }
        }
    }

    //NSLog(@"Format %@",bestFormat);

    if ( bestFormat ) {
        if ( [device lockForConfiguration:NULL] == YES ) {
            device.activeFormat = bestFormat;
            device.activeVideoMinFrameDuration = bestFrameRateRange.minFrameDuration;
            device.activeVideoMaxFrameDuration = bestFrameRateRange.minFrameDuration;
            [device unlockForConfiguration];
        }
    }
}


Path parameters

I found how this working by debugging. There is no information in docs.
When I pass one parameter like id it just works
    case DELETEApiActivitiesIdJson(let id):
      return "/api/activities/\(id)"

But when I pass multiple parameters it behaves like object
    case PATCHApiActivitiesIdJson(let activity):
      return "/api/activities/\(activity.id)/"

A little bit confusing don't you think? Thanks.

Hey!
It is because you are assigning tuple of parameters to the activity constant. It is now a tuple and when you have your variables named then you can access it like you have shown activity.id etc. If you didn't have them named, access to it would be like activity.0, activity.1 etc. If you want to assign your parameters not to a tuple, but to a variables, just specify them in the parenthesis, like:
case PATCHApiActivitiesIdJson(let id, let nextParam, let nextNextParam):
      return "/api/activities/\(id)/"

Hope it is now clear :beers:

@sunshinejr thanks for quick reply. Yeah it helps. The problem though, is why id is not a tuple? I guess it is a language feature, I need to learn a bit more swift :)

@onemanstartup If you specify only one parameter (when you need to assign more than one) in enum's case, it will convert it to a tuple of parameters, otherwise it won't. So in your case, if you have e.g. 3 associated types, when you specify one, all parameters are converted into a tuple (because you need to catch all the values), and then passed to the variable. If you specify all parameters, it doesn't convert it to the tuple, that's why id in my case isn't a tuple, because we have all parameters already.
Don't worry, swift is evolving all the time, no-one knows everything about it, learning is a key. Keep it up :)  🎉

@sunshinejr got it, thank you very much for explanation!


Update index form

Change Voyager form text to Alma
Remove item and holding form elements (endpoints are deprecated)
Remove reindex form field
Deprecates update route

Closes #1472
Closes #1476

@hackartisan Updated to remove reindex form field and deprecate the update route and controller method. Ready for re-review.


Add tests for btree_delete data structure erase() method

Codecov Report

:exclamation: No coverage uploaded for pull request base (master@a6e9e42). Click here to learn what that means.
The diff coverage is n/a.

@@            Coverage Diff            @@
##             master       #2   +/-   ##
=========================================
  Coverage          ?   52.55%
=========================================
  Files             ?      364
  Lines             ?    16591
  Branches          ?        0
=========================================
  Hits              ?     8720
  Misses            ?     7871
  Partials          ?        0


regexp: add the missing is

fix a grammer mistake

/check cla

I signed it!

Yes, this may not be a fix, but adding the is makes it more readable for  non-native speakers


can't install det_tools_cuda

Do i have dependencies not installed?

All you need is cuda, cudnn and pytorch. I tried again on ubuntu 18.04, torch1.5.0, cuda 10.0 and cudnn 7.5, but I found no problems. It looks like a compiler problem. Maybe you should try to compile with x86_64-linux-gnu-g ++.

I can install det_tools_cuda with ubuntu 18.04, torch 1.5.0, cuda 10.1, but when I load det_tool_cuda, this error came out ImportError: /home/Desktop/crowddet/lib/python3.7/site-packages/det_tools_cuda-0.1-py3.7-linux-x86_64.egg/det_tools_cuda.cpython-37m-x86_64-linux-gnu.so: undefined symbol: THPVariableClass, I think cuda version causes the problem

I wonder if you could provide a cpu version of this "det_tools", thank you

I meet the same problem !!did you solve it? @lyokka @LouisNiZhengbin
did this project support cuda 9.0? my device can only support cuda 9.0 at most, thank for your reply @Purkialo

This module can be replaced by "torchvision" operation. I will update the code in a few days. If you are in a hurry, please replace them yourself.

@Purkialo   thanks for your reply!!


Unable to Launch Waybar with river/tags in config

When i launch Waybar I am greeted with an error message :

river_status_manager_v1 not advertised
text.txt

I reproduce it.

Same issue with river compositer. I get this error:
Gdk-Message: 01:18:19.157: Error 88 (Socket operation on non-socket) dispatching to Wayland display.

@Alexays what could be the issue here ?  Socket operation on non socket
this looks related to gtk layer shell ?  Is this on part of river compositor , gtk layer shell or waybar ?

But when I click on the pulseaudio module if does open the the pavucontrol tool in a new window . So I am thinking gtk layer shell is fine. The problem may be on river not opening a socket that waybar is expecting or waybar is looking in the wrong location.
I want to look into the issue just need some direction

Even I am facing the same issue.
** (waybar:9986): WARNING **: 18:57:44.100: gtk-layer-shell v0.6.0 may not work on GTK v3.24.30. If you experience crashes, check https://github.com/wmww/gtk-layer-shell/blob/master/compatibility.md

(waybar:9986): GLib-GObject-WARNING **: 18:57:44.100: ../glib/gobject/gsignal.c:2081: type 'GtkWindow' is already overridden for signal id '73'

(waybar:9986): GLib-GObject-WARNING **: 18:57:44.100: ../glib/gobject/gsignal.c:2081: type 'GtkWindow' is already overridden for signal id '72'
[2021-11-02 18:57:44.100] [error] river_status_manager_v1 not advertised
Gdk-Message: 18:57:44.103: Error 88 (Socket operation on non-socket) dispatching to Wayland display.

Even I am facing the same issue.
** (waybar:9986): WARNING **: 18:57:44.100: gtk-layer-shell v0.6.0 may not work on GTK v3.24.30. If you experience crashes, check https://github.com/wmww/gtk-layer-shell/blob/master/compatibility.md

(waybar:9986): GLib-GObject-WARNING **: 18:57:44.100: ../glib/gobject/gsignal.c:2081: type 'GtkWindow' is already overridden for signal id '73'

(waybar:9986): GLib-GObject-WARNING **: 18:57:44.100: ../glib/gobject/gsignal.c:2081: type 'GtkWindow' is already overridden for signal id '72'
[2021-11-02 18:57:44.100] [error] river_status_manager_v1 not advertised
Gdk-Message: 18:57:44.103: Error 88 (Socket operation on non-socket) dispatching to Wayland display.

can you mention which gtk version are you on??

Even I am facing the same issue.
** (waybar:9986): WARNING **: 18:57:44.100: gtk-layer-shell v0.6.0 may not work on GTK v3.24.30. If you experience crashes, check https://github.com/wmww/gtk-layer-shell/blob/master/compatibility.md

(waybar:9986): GLib-GObject-WARNING **: 18:57:44.100: ../glib/gobject/gsignal.c:2081: type 'GtkWindow' is already overridden for signal id '73'

(waybar:9986): GLib-GObject-WARNING **: 18:57:44.100: ../glib/gobject/gsignal.c:2081: type 'GtkWindow' is already overridden for signal id '72'
[2021-11-02 18:57:44.100] [error] river_status_manager_v1 not advertised
Gdk-Message: 18:57:44.103: Error 88 (Socket operation on non-socket) dispatching to Wayland display.

can you mention which gtk version are you on??

gtk3-1:3.24.30+90+g20be04f7ac-1 on arch

If you see the error on river - it is caused by an incorrect binding to the zriver_status_manager_v1 interface. https://github.com/Alexays/Waybar/commit/024fd42e272f79cb08e594eb3af86c93b1446c91 fixes that and is required to use river/tags with current versions of river. Your options are to use waybar-git or to convince Arch maintainer to add the patch.
If you see it not on river - it's' expected. river/tags uses protocols specific to river and will fail with river_status_manager_v1 not advertised on any other compositor.
Gtk (with gtk-layer-shell) simply uses the same wayland connection and receives the protocol errors caused by the issues above.

If you see the error on river - it is caused by an incorrect binding to the zriver_status_manager_v1 interface. 024fd42 fixes that and is required to use river/tags with current versions of river. Your options are to use waybar-git or to convince Arch maintainer to add the patch.
If you see it not on river - it's' expected. river/tags uses protocols specific to river and will fail with river_status_manager_v1 not advertised on any other compositor.
Gtk (with gtk-layer-shell) simply uses the same wayland connection and receives the protocol errors caused by the issues above.

Thanks for the info! After trying with source compiled waybar, it is working with river.


From Dataset Library, embed private Data Explorers

Fixes #1457. #1533 was for public DEs; this PR is for private DEs. FYI @seanhorgan
Private DEs use Identity-Aware Proxy (IAP) to restrict access to a Terra group. Unfortunately, IAP makes embedding in an iframe complicated.
Before this PR:

Say user has not done oauth flow for AMP PD DE
User clicks "Browse data"
AMP PD OAuth sign-in opens in new tab

After embedding DE in iframe instead of opening a new tab:

Say user has not done oauth flow for AMP PD DE
User clicks "Browse data"
AMP PD OAuth cannot appear in embedded iframe due to CORS errors. In general, login flow cannot happen in an iframe for security reasons.

So unfortunately terra-ui must manually detect and handle the "user not logged into DE" case.
If user not in DE auth domain
If user is not in DE auth domain and tries to access http://localhost:3000/#library/datasets/AMP PD - 2019_v1beta_0220/data-explorer, user sees:

After clicking "apply for access":

If user in DE auth domain and has not done oauth flow for DE
User is redirected to DE oauth flow:

Note: After the oauth screen, user is at https://amp-pd-data-explorer.appspot.com, not http://localhost:3000/#library/datasets/AMP PD - 2019_v1beta_0220/data-explorer. This only happens the first time DE is accessed. On subsequent visits, http://localhost:3000/#library/datasets/AMP PD - 2019_v1beta_0220/data-explorer shows embedded DE like normal.
If user in DE auth domain, has done oauth flow for DE, has not used DE from this brower
User is redirected to DE oauth flow:

If user in DE auth domain and has done oauth flow for DE, has used DE from this brower
DE is embedded like normal:

Logged out and access public DE
Works with no console errors.

Ping?


add smoke test for jre

Signed-off-by: Yixin Qian<EMAIL_ADDRESS>Fixes: https://github.com/adoptium/temurin-build/issues/2674

internal jdk-linux-x64-openj9_SmokeTests/28/

We are in a code freeze - so @sophia-guo to approve and merge if its critical for the release

Tests failed in github PR workflow with error:
/bin/sh: /github/home/JDK/jdk-17+31/../j2re-image/bin/java: not found

This PR is for testing JRE. Does the github PR build have JRE staged?

@OscarQQ could you run a Grinder using https://ci.adoptopenjdk.net/job/Grinder/ ? Thanks

Re: https://github.com/adoptium/temurin-build/pull/2675#issuecomment-883478792
Short answer is 'no'.

https://ci.adoptopenjdk.net/job/Grinder/1132/

@OscarQQ could you run a Grinder using https://ci.adoptopenjdk.net/job/Grinder/ ? Thanks

Is this required for the release?

Is this required for the release?

It’s not required, we could merge this after the release

@OscarQQ - This test seems to be failing...

@karianna Oscar's internship has ended. The changes add a test for JRE, but the auto PR builds do not stage JRE. This is not the problem with the change.
The change is tested in Grinder and it works fine:
mac: https://ci.adoptopenjdk.net/job/Grinder/1352/
xlinux: https://ci.adoptopenjdk.net/job/Grinder/1353/

@sxa could you review this PR again? Thanks

@sxa could you review this PR again? Thanks

i don't think my previous comment about Content/Home has been addressed, so that question still stands :-)

i don't think my previous comment about Content/Home has been addressed, so that question still stands

The PR was updated and the test passed on mac. Could you be more specific on what is not addressed?

In addition, this seems to be throwing errors relating to not executing the java executable properly so needs that to be fixed

As mentioned in the meeting, the failure in the PR builds is due to JRE not staged in PR builds. It is not related to this change. The PR builds need to be updated to include JRE staging. This is a separate issue.

This will fail as the GitHub Action workflow file doesn't pull in a JRE.
Something along the lines of replicating the snippet in build.yml under .github/workflws:
name: Unpack jdk
      run: |
        mkdir -p "${HOME}/JDK"
        tar -xf "${GITHUB_WORKSPACE}/workspace/target/OpenJDK.tar.gz" -C "${HOME}/JDK"

this has been stale for over 2 years, converting to "draft", if no longer needed please close.

Actually for this one we can likely close as at the time, Oscar was a student working temporarily at the project.


Fix Regular Expression Denial of Service in glob-parent

Published<EMAIL_ADDRESS>


new logo

What is the purpose of this pull request?
Fresh logo arrives for this project, but still being simple.
How is this achieved?
Adobe Illustrator
Which issue number does this fix?
#35

Thank you so much for the new logo. Love the design and love all the contributions you have made to the project.
Merging now, and I hope you continue to contribute to simple.css in the big ways that you already have.

On Oct 4, 2017, at 11:44 AM, dvL<EMAIL_ADDRESS>wrote:
What is the purpose of this pull request?
Fresh logo arrives for this project, but still being simple.
How is this achieved?
Adobe Illustrator
Which issue number does this fix?
#35 https://github.com/cpdevelops/simple.css/issues/35
You can view, comment on, or merge this pull request online at:
https://github.com/cpdevelops/simple.css/pull/37 https://github.com/cpdevelops/simple.css/pull/37
Commit Summary
replaces default logo with fresh one...
color classes not getting applied...
File Changes
M README.md https://github.com/cpdevelops/simple.css/pull/37/files#diff-0 (2)
D logo.png https://github.com/cpdevelops/simple.css/pull/37/files#diff-1 (0)
A logo.svg https://github.com/cpdevelops/simple.css/pull/37/files#diff-2 (7)
Patch Links:
https://github.com/cpdevelops/simple.css/pull/37.patch https://github.com/cpdevelops/simple.css/pull/37.patch
https://github.com/cpdevelops/simple.css/pull/37.diff https://github.com/cpdevelops/simple.css/pull/37.diff
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub https://github.com/cpdevelops/simple.css/pull/37, or mute the thread https://github.com/notifications/unsubscribe-auth/APfr978WYFS_0LkktjeLiWvcT_ZEpDdRks5so7XqgaJpZM4Pt6TR.


Add support for Storybook 5

Right now when installing this addon with storybook 5 you get this warning in yarn:
warning " ><EMAIL_ADDRESS>has incorrect peer dependency "<EMAIL_ADDRESS>warning " ><EMAIL_ADDRESS>has unmet peer dependency "<EMAIL_ADDRESS>
It seems like the addon works fine in SB5 so should be fine to bump the dependency to ^4.0.0||^5.0.0.

Thank you for the report, I'll have a look asap.

Released version 1.0.3, with support for Storybook 5 😄

Just upgraded thanks, one thing though - do you actually need to specify @storybook/addons in dependencies and peerDependencies at all? @storybook/addons-actions includes @storybook/addons as a dependency, and you don't reference it directly in the code in this package also.
Right now I have to add @storybook/addons as a dependency for no reason to my package.json because you've specified it as a peer dependency.

You're right, fixed with 1.0.5. Thank you for the report.


[BUG]: Photo not saved - command line works though

Describe the bug
Hi,
when I use command line --capture-image-and-download everything works fine, also with www-data user. However, I can't get it to work via the application.
Camera is triggered, picture is taken but then the error message comes.
Collection works up to final picture (I also see al photos). Thus, must be a permission issue or so.
Raspberry Pi 3B, latest OS (minimal)
Latest version of Photobooth
Canon EOS 600D
Steps to reproduce the behavior

Expected behavior

Photobooth Version
4.3.1
Browser and browser version
Chrome
Operating System
Raspberry Pi OS
Did it work before?
No
Latest working version

Additional context

You've used the installer for setup or setup by hand?
Followed the instructions inside the FAQ?
https://photoboothproject.github.io/FAQ#i-get-the-error-message-something-went-wrong-while-taking-a-picure-what-can-i-do
Please post the Photobooth log, access via Adminpanel -> Debugpanel
Also please post the output of
cat /var/www/html/HEAD

(Enter in your terminal)

Hi, I'm the problem it's me... [contemporary American philosopher]
After hours of trying to find the glitch, I realized I picked the only ancient Raspberry 2B I had in my drawer. After discovering that and switching to a 3B, it works perfectly fine.
Thanks for the effort you put into this project!
And sorry for the "fake" bug...

Thanks for the feedback. Maybe a Pi Camera works on a Pi 2, in case it's an option for you too.
Closing the issue. If you have further questions you're also welcome to join our community on telegram.
Best regards
Andi


Attachments of nested Outlook messages (being attachments themselves) missing

Originally reported under #298:
When reading nested outlook messages back from the attachment datasource (as attachments on an Email instance are datasources), attachments said outlook message are missing.
The reason for this is that reading nested Outlook messages as attachment of another Outlook msg is only possible by converting it to a Java structure first (using outlook-message-parser). This is a one-way conversion. Since the nested outlook message-as-an-attachment should be represented as attachment under an Email instance, it should be serialized to a datasource. Nested attachments then of this nested Outlook message are datasources themselves and cannot be serialized (javax.activation.DataSource is a JDK interface).
To solve this problem, a more comprehensive serialization solution is needed. Kryo should solve the problem nicely.

Released in 6.5.3


This short grammar doesn't work... Probably user error.

lamcalc {

expr
	= variable
	| "λ" variable "." expr
	| "(" expr expr ")"

variable
	= letter*

}

...gives: Rule expr involves an alternation which has inconsistent arity (expected 1, got 4) on first line that contains a |.

Hi Dave,
You should read through the math tutorial / demo, which has a really good
explanation of arities, etc.:
https://github.com/harc/ohm/blob/master/examples/math/index.html
There's also a good explanation in Sec. 2.3 of this paper:
https://ohmlang.github.io/pubs/dls2016/modular-semantic-actions.pdf
Cheers,
Alex
On Wed, Mar 29, 2017 at 9:59 AM, Dave Loyall<EMAIL_ADDRESS>wrote:

lamcalc {
expr
= variable
| "λ" variable "." expr
| "(" expr expr ")"
variable
= letter*
}
...gives: Rule expr involves an alternation which has inconsistent arity
(expected 1, got 4) on first line that contains a |.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/harc/ohm-editor/issues/32, or mute the thread
https://github.com/notifications/unsubscribe-auth/AAPHi4VrN8bl1iTwTHPVb5X9xiH83JEDks5rqo3ugaJpZM4MtRFL
.

The short answer is that you can fix it by adding a name at the end of each clause
expr 	= variable                     -- variable 	| "λ" variable "." expr  -- variableWithExpression 	| "(" expr expr ")"       -- expressionWithParens
The long answer is in the comments here:
https://github.com/harc/ohm/blob/482b6937781a2f1b7d752df7dbaf9d4367738210/examples/math/index.html#L180

Thanks, you two!

This is terrible idea. I made the grammar rules in about 30 min. But already spent 4 hours to make the semantic rules work and still can't, it's extremely hard to work with.


Migrate alw integration artifact repositories to digiwf-core

As a software developer I want to integrate the digiwf-alw-integration into the digiwf-core monorepository to simplify maintenance.
Tasks

Add alw integration artifact to the digiwf-integrations package
Configure pom.xmls to integrated the integration into the build mechanism
pom.xml uses versions of shared packages from the parent (root pom in the digiwf-core)
Migrate open issues from the repository to digiwf-core
Archive old repository

Criteria

Integration artifact is integrated into the digiwf-core monorepo
Integration artifact is integrated into the build pipeline
Issues are migrated to digiwf-core
Old repository is archived
Repository documentation is updated

done


Sometimes 500 error appear on request to /counter

Sometimes it is working ok, but sometimes it is not, here is traceback. Last git version.
[E 170117 11:00:47 app:1560] Exception on /counter [GET]
    Traceback (most recent call last):
      File "/usr/local/lib/python3.4/dist-packages/flask/app.py", line 1982, in wsgi_app
        response = self.full_dispatch_request()
      File "/usr/local/lib/python3.4/dist-packages/flask/app.py", line 1614, in full_dispatch_request
        rv = self.handle_user_exception(e)
      File "/usr/local/lib/python3.4/dist-packages/flask/app.py", line 1517, in handle_user_exception
        reraise(exc_type, exc_value, tb)
      File "/usr/local/lib/python3.4/dist-packages/flask/_compat.py", line 33, in reraise
        raise value
      File "/usr/local/lib/python3.4/dist-packages/flask/app.py", line 1612, in full_dispatch_request
        rv = self.dispatch_request()
      File "/usr/local/lib/python3.4/dist-packages/flask/app.py", line 1598, in dispatch_request
        return self.view_functions[rule.endpoint](**req.view_args)
      File "/opt/pyspider/pyspider/webui/index.py", line 98, in counter
        for project, counter in iteritems(counters):
      File "/usr/local/lib/python3.4/dist-packages/six.py", line 581, in iteritems
        return iter(d.items(**kw))
    AttributeError: 'NoneType' object has no attribute 'items'

You should see exception logs in scheduler at same time when this exception happens. Could you also paste the logs from scheduler?

Here it is:
[E 170121 22:40:03 scheduler:690]
    Traceback (most recent call last):
      File "/opt/pyspider/pyspider/scheduler/scheduler.py", line 688, in dump_counter
        return self._cnt[_time].to_dict(_type)
      File "/opt/pyspider/pyspider/libs/counter.py", line 415, in to_dict
        result[key] = value.to_dict(get_value)
      File "/opt/pyspider/pyspider/libs/counter.py", line 315, in to_dict
        for key, value in iteritems(self):
      File "/usr/lib/python3.4/_collections_abc.py", line 498, in __iter__
        yield (key, self._mapping[key])
      File "/opt/pyspider/pyspider/libs/counter.py", line 281, in __getitem__
        for _key in self.manager.counters.keys():
    RuntimeError: dictionary changed size during iteration

Thanks. Got it, I would fix it soon.
On Sun, 22 Jan 2017, 06:40 volvofixthis<EMAIL_ADDRESS>wrote:

Here it is:
[E 170121 22:40:03 scheduler:690]
Traceback (most recent call last):
File "/opt/pyspider/pyspider/scheduler/scheduler.py", line 688, in dump_counter
return self._cnt[_time].to_dict(_type)
File "/opt/pyspider/pyspider/libs/counter.py", line 415, in to_dict
result[key] = value.to_dict(get_value)
File "/opt/pyspider/pyspider/libs/counter.py", line 315, in to_dict
for key, value in iteritems(self):
File "/usr/lib/python3.4/_collections_abc.py", line 498, in iter
yield (key, self._mapping[key])
File "/opt/pyspider/pyspider/libs/counter.py", line 281, in getitem
for _key in self.manager.counters.keys():
RuntimeError: dictionary changed size during iteration
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/binux/pyspider/issues/618#issuecomment-274293016, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AAndM5SkbrpLSUcu7b4srp5_mv3MZbiHks5rUolwgaJpZM4LlgX4
.


Can model composition in go-swagger?

Problem statement
like this

@success 200 {object} rest.RspProto{data=rest.PaginationResult}

Swagger specification
Steps to reproduce
Environment
swagger version: x.x.x
go version: x.x.x
OS:

Hello @shengwudiyi. Could you elaborate a bit, please?

Hello @fredbi  😊
i want to reply with a common structure
RspProto struct {
 Code    int         `json:"code"`
 Message string      `json:"msg"`
 Data    interface{} `json:"data,omitempty"`
}

but Data s are different among requests, how do I describe responses

@shengwudiyi
Like so:
  ....
  response:
    description: "generic"
      schema:
        $ref: '#/definitions/rspProto'

definitions:
  rspProto:
    type:
      object
   properties:
     codeinteger:
       type: integer
    message:
       type: string
    data:
      type: object


Add VK.com

VK (old name VKontakte, "in contact") is a very active social network of Russian origin, it's audience size is ~5% of that of Facebook, which is still incredibly huge.

API docs: https://new.vk.com/dev/share_details

@mxstbr do you want to limit networks to international ones?
@lolmaus check the contribution notes here https://github.com/mxstbr/sharingbuttons.io/wiki

I'm fine with VK since it's huge, I think we could just not enable it by default?
(Also, that contribution guide is awesome! Thanks!)


fix: Avoid creating huge duplicate of canonicalized plans for CometNativeExec

Which issue does this PR close?

Closes #594.
Rationale for this change

I encountered OOM issue when trying to enable columnar shuffle for TPCDS queries in #613. I ran memory profiling and found that a lot of Spark expressions are allocated, e.g., AttributeReference:

It seems caused by the recursively canonicalization in canonicalizePlans on the original plan parameter. I think it is because when we transform the query plan, original plans in each operator could reference mix of Spark and Comet plans. When the canonical plans are required, it produces huge duplicate of canonicalized plans for each query snippets.
We don't need to rely on the original plan to compare canonical plans of Comet. This patch simply changes the canonical plan of the original plan to null.
What changes are included in this PR?

How are these changes tested?

Merged. Thanks @andygrove


0.8.2-RC1 is failing constaintly

I upgraded from 0.8.1-RC1 to 0.8.2-RC1 and cluster is constantly failing over because of segfaults. Master is on 0.21.1, slaves as well. CPU usage seems to be bigger as well, 40% -> 110% on the leading node. Marathon is running from official docker image.
F0506 12:01:20.664190   355 check.hpp:79] Check failed: f.isReady()
*** Check failure stack trace: ***
    @     0x7f156f0e6dfd  google::LogMessage::Fail()
    @     0x7f156f0e8c3d  google::LogMessage::SendToLog()
    @     0x7f156f0e69ec  google::LogMessage::Flush()
    @     0x7f156f0e9539  google::LogMessageFatal::~LogMessageFatal()
    @     0x7f156f0dd904  _checkReady<>()
    @     0x7f156f0dbdd8  Java_org_apache_mesos_state_AbstractState__1_1names_1get
    @     0x7f15dd012d98  (unknown)
#
# A fatal error has been detected by the Java Runtime Environment:
#
#  SIGSEGV (0xb) at pc=0x00007f15e8276227, pid=1, tid=139727079986944
#
# JRE version: OpenJDK Runtime Environment (7.0_79-b14) (build 1.7.0_79-b14)
# Java VM: OpenJDK 64-Bit Server VM (24.79-b02 mixed mode linux-amd64 compressed oops)
# Derivative: IcedTea 2.5.5
# Distribution: Ubuntu 14.04 LTS, package 7u79-2.5.5-0ubuntu<IP_ADDRESS>
# Problematic frame:
# C  [libc.so.6+0x3a227]  abort+0x297
#
# Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
#
[2015-05-06 11:59:46,865] INFO started processing 35 offers, launching at most 1 tasks per offer and 1000 tasks in total (mesosphere.marathon.tasks.IterativeOfferMatcher$:124)
[2015-05-06 11:59:46,867] INFO Launched 0 tasks on 0 offers, declining 35 (mesosphere.marathon.tasks.IterativeOfferMatcher$:216)
# An error report file with more information is saved as:
# /tmp/hs_err_pid1.log
[2015-05-06 11:59:47,053] INFO <IP_ADDRESS> -  -  [06/May/2015:11:59:46 +0000] "GET /v2/tasks HTTP/1.1" 200 1876 "-" "curl/7.26.0" (mesosphere.chaos.http.ChaosRequestLog:15)
#
# If you would like to submit a bug report, please include
# instructions on how to reproduce the bug and visit:
#   http://icedtea.classpath.org/bugzilla
# The crash happened outside the Java Virtual Machine in native code.
# See problematic frame for where to report the bug.
#
[2015-05-06 11:59:47,298] INFO <IP_ADDRESS> -  -  [06/May/2015:11:59:46 +0000] "GET /v2/apps?embed=apps.tasks HTTP/1.1" 200 63888 "-" "Go 1.1 package http" (mesosphere.chaos.http.ChaosRequestLog:15)

[error occurred during error reporting , id 0xb]

[error occurred during error reporting , id 0xb]

[error occurred during error reporting , id 0xb]

[error occurred during error reporting , id 0xb]

[error occurred during error reporting , id 0xb]

F0506 11:57:46.698317   154 org_apache_mesos_state_AbstractState.cpp:696] CHECK_READY(*future): is PENDING
*** Check failure stack trace: ***
F0506 11:57:46.724473   146 check.hpp:79] Check failed: f.isReady()
*** Check failure stack trace: ***
    @     0x7f57af0e6dfd  google::LogMessage::Fail()
    @     0x7f57af0e6dfd  google::LogMessage::Fail()
    @     0x7f57af0e8c3d  google::LogMessage::SendToLog()
    @     0x7f57af0e8c3d  google::LogMessage::SendToLog()
    @     0x7f57af0e69ec  google::LogMessage::Flush()
    @     0x7f57af0e69ec  google::LogMessage::Flush()
    @     0x7f57af0e9539  google::LogMessageFatal::~LogMessageFatal()
    @     0x7f57af0e9539  google::LogMessageFatal::~LogMessageFatal()
    @     0x7f57af0dbeab  Java_org_apache_mesos_state_AbstractState__1_1names_1get
    @     0x7f57af0dd904  _checkReady<>()
    @     0x7f57cd012d98  (unknown)
    @     0x7f57af0dbdd8  Java_org_apache_mesos_state_AbstractState__1_1names_1get
    @     0x7f57cd012d98  (unknown)
#
# A fatal error has been detected by the Java Runtime Environment:
#
#  SIGSEGV (0xb) at pc=0x00007f57d8263227, pid=1, tid=140010480133888
#
# JRE version: OpenJDK Runtime Environment (7.0_79-b14) (build 1.7.0_79-b14)
# Java VM: OpenJDK 64-Bit Server VM (24.79-b02 mixed mode linux-amd64 compressed oops)
# Derivative: IcedTea 2.5.5
# Distribution: Ubuntu 14.04 LTS, package 7u79-2.5.5-0ubuntu<IP_ADDRESS>
# Problematic frame:
# C  [libc.so.6+0x3a227]  abort+0x297
#
# Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
#
# An error report file with more information is saved as:
# /marathon/hs_err_pid1.log
#
# If you would like to submit a bug report, please include
# instructions on how to reproduce the bug and visit:
#   http://icedtea.classpath.org/bugzilla
# The crash happened outside the Java Virtual Machine in native code.
# See problematic frame for where to report the bug.
#

[error occurred during error reporting , id 0xb]

[error occurred during error reporting , id 0xb]

[error occurred during error reporting , id 0xb]

[error occurred during error reporting , id 0xb]

[error occurred during error reporting , id 0xb]

[error occurred during error reporting , id 0xb]

[error occurred during error reporting , id 0xb]

[error occurred during error reporting , id 0xb]

[error occurred during error reporting , id 0xb]

[error occurred during error reporting , id 0xb]

F0506 12:01:20.664190   355 check.hpp:79] Check failed: f.isReady()
*** Check failure stack trace: ***
    @     0x7f156f0e6dfd  google::LogMessage::Fail()
    @     0x7f156f0e8c3d  google::LogMessage::SendToLog()
    @     0x7f156f0e69ec  google::LogMessage::Flush()
    @     0x7f156f0e9539  google::LogMessageFatal::~LogMessageFatal()
    @     0x7f156f0dd904  _checkReady<>()
    @     0x7f156f0dbdd8  Java_org_apache_mesos_state_AbstractState__1_1names_1get
    @     0x7f15dd012d98  (unknown)
#
# A fatal error has been detected by the Java Runtime Environment:
#
#  SIGSEGV (0xb) at pc=0x00007f15e8276227, pid=1, tid=139727079986944
#
# JRE version: OpenJDK Runtime Environment (7.0_79-b14) (build 1.7.0_79-b14)
# Java VM: OpenJDK 64-Bit Server VM (24.79-b02 mixed mode linux-amd64 compressed oops)
# Derivative: IcedTea 2.5.5
# Distribution: Ubuntu 14.04 LTS, package 7u79-2.5.5-0ubuntu<IP_ADDRESS>
# Problematic frame:
# C  [libc.so.6+0x3a227]  abort+0x297
#
# Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
#
# An error report file with more information is saved as:
# /tmp/hs_err_pid1.log
#
# If you would like to submit a bug report, please include
# instructions on how to reproduce the bug and visit:
#   http://icedtea.classpath.org/bugzilla
# The crash happened outside the Java Virtual Machine in native code.
# See problematic frame for where to report the bug.
#

[error occurred during error reporting , id 0xb]

[error occurred during error reporting , id 0xb]

[error occurred during error reporting , id 0xb]

[error occurred during error reporting , id 0xb]

[error occurred during error reporting , id 0xb]

[error occurred during error reporting , id 0xb]

Marathon 0.8.2-RC1 was released before Mesos 0.22.1, so it doesn't include the fixes for this bug. The final 0.8.2 will include them.

0.21.1, not 0.22.1 that is not even released yet.

0.22.1 has been released yesterday and should be available from the Mesosphere repos. It includes a fix for this bug. I'm not sure why this seems to happen more often with the current Marathon RC for you, but we didn't change the Mesos dependency from 0.8.1 to 0.8.2-RC1. If 0.8.1 works for you please downgrade and wait for the final and upgrade Mesos and Marathon when it's available.

Will do, thanks for clearer explanation.


gnome-control-center installed brakes wayland programs

Describe the bug
If gnome-control-center is installed on my Arch system, all wayland programs installed via Nix fails to start giving the following error:
GLib-GIO-ERROR **: 00:02:57.432: Settings schema 'org.gnome.settings-daemon.plugins.xsettings' does not contain a key named 'antialiasing'
zsh: trace trap (core dumped)

To Reproduce
Steps to reproduce the behavior:

Install gnome-control-center on Arch
Run some wayland program from nixpkgs. Example: nix run nixpkgs.wofi -c wofi --show run
See above error.
Uninstall gnome-control-center and repeat step 2.
See no errors.

Expected behavior
I don't know what to expect honestly, as I keep pacman installed packages to a minimum, but didn't knew that having that package installed made that error happens and for what reason it does.
Metadata
Please run nix-shell -p nix-info --run "nix-info -m" and paste the result.
 - system: `"x86_64-linux"`
 - host os: `Linux 5.11.13-arch1-1, Arch Linux, noversion`
 - multi-user?: `yes`
 - sandbox: `yes`
 - version: `nix-env (Nix) 2.3.10`
 - channels(pablo): `"home-manager, nixpkgs-21.05pre282987.294d1925af6"`
 - channels(root): `"nixpkgs-21.05pre282987.294d1925af6, nixos-20.09.3827.389249fa9b3"`
 - nixpkgs: `/nix/var/nix/profiles/per-user/root/channels/nixpkgs`

Same issue here:
I can't run any nix installed program.
I use GNOME 3 with Wayland on archlinux.
VGA: AMD RX 5700XT
`these paths will be fetched (0.51 MiB download, 2.48 MiB unpacked):
/nix/store/059m11gqd5yjjj9wpmlhqn6i9rl0zya2-bash-interactive-4.4-p23-man
/nix/store/0vxmxszx1v9j4ffpvc1m21p0zwhgrjz2-bash-interactive-4.4-p23-doc
/nix/store/1hg7ssk7dzpmccsz018p8vb9jr3pq47i-nix-info
/nix/store/j7g6w8n9yvlraz45cd8myf60yrbqdlkr-bash-interactive-4.4-p23-info
/nix/store/y8fkm1p4s3al9p29kxargz30h1hkjlwj-bash-interactive-4.4-p23-dev
copying path '/nix/store/0vxmxszx1v9j4ffpvc1m21p0zwhgrjz2-bash-interactive-4.4-p23-doc' from 'https://cache.nixos.org'...
copying path '/nix/store/y8fkm1p4s3al9p29kxargz30h1hkjlwj-bash-interactive-4.4-p23-dev' from 'https://cache.nixos.org'...
copying path '/nix/store/j7g6w8n9yvlraz45cd8myf60yrbqdlkr-bash-interactive-4.4-p23-info' from 'https://cache.nixos.org'...
copying path '/nix/store/059m11gqd5yjjj9wpmlhqn6i9rl0zya2-bash-interactive-4.4-p23-man' from 'https://cache.nixos.org'...
copying path '/nix/store/1hg7ssk7dzpmccsz018p8vb9jr3pq47i-nix-info' from 'https://cache.nixos.org'...
bash: warning: setlocale: LC_ALL: cannot change locale (en_US.UTF-8)
/nix/store/6737cq9nvp4k5r70qcgf61004r0l2g3v-bash-4.4-p23/bin/bash: warning: setlocale: LC_ALL: cannot change locale (en_US.UTF-8)

system: "x86_64-linux"
host os: Linux 5.11.16-arch1-1, Arch Linux, noversion
multi-user?: yes
sandbox: yes
version: nix-env (Nix) 2.3.6
channels(root): "nixpkgs-20.09pre238494.96745f02283"
channels(archio): "nixpkgs-21.05pre283554.d9448c95c5d"
channels(lvg0): "nixpkgs-21.03pre256488.b3abbd61f52"
nixpkgs: /nix/var/nix/profiles/per-user/root/channels/nixpkgs
`

Same issue here:
I can't run any nix installed program.
I use GNOME 3 with Wayland on archlinux.
VGA: AMD RX 5700XT
 - system: `"x86_64-linux"`
 - host os: `Linux 5.11.16-arch1-1, Arch Linux, noversion`
 - multi-user?: `yes`
 - sandbox: `yes`
 - version: `nix-env (Nix) 2.3.6`
 - channels(root): `"nixpkgs-20.09pre238494.96745f02283"`
 - channels(archio): `"nixpkgs-21.05pre283554.d9448c95c5d"`
 - channels(lvg0): `"nixpkgs-21.03pre256488.b3abbd61f52"`
 - nixpkgs: `/nix/var/nix/profiles/per-user/root/channels/nixpkgs`

Did you installed GNOME through Nix or Pacman?

GNOME 40 has been since merged so this should be fixed on nixos-unstable.

will these issues be fixed in nixos 21.05? I have similiar issue when trying to run tilix now

Yes, the GTK version is in 21.05.

thanks. i had an old package installed somehow, updating solved my problem on 21.05. thanks


There is no way to tell which what workflow type it is

"Am I in PyFr, Paravieweb? What's the name of this project? What did I click on again?

related #172

We should start using Redux so we can have a single data model which will ease things out for handling this use case.
For instance once we dive into a project, the project name/type can be put in the middle of the top bar or event in the title bar of the browser.

[x] can tell simulation project name
[ ] can tell project type

Can determine project type through other cues. closing.


Proposal: Reduce the number of transactions during MUD deployment by bulk registering the function selectors

I have noticed that the MUD framework emits a significant number of transactions during deployment to the chain, particularly in the function selectors section. Each function selector currently requires a unique transaction, which is not gas efficient. To improve this, I propose implementing a bulk register optimization that would reduce the number of transactions, resulting in cost savings and a reduced risk of deployment failures.
You can find the relevant code for this proposal at the following link:
https://github.com/latticexyz/mud/blob/788de8de9f360dcc65b6c2469b8855502c23582a/packages/cli/src/utils/deploy.ts#L211

It’d be nice if there was a general purpose multi write thing. I’m sure we could batch more than just registering function selectors.

It’d be nice if there was a general purpose multi write thing. I’m sure we could batch more than just registering function selectors.

Thank you for the response. I created a PR triyng to mitigate this issue
https://github.com/latticexyz/mud/pull/1287


op-guide/clustering: fix typo

Contributing guidelines
Please read our contribution workflow before submitting a pull request.

lgtm.
Next time you can force-push to your local branch instead of creating a new PR.
Thanks!


Page 41 Creating WebApp Learn Azure in mol

Hello, I am really new with the cloud stuff and I am following the "Learn Azure in Month of Lunches" I am on page 41 and I am stuck. I am stuck on the following instruction "git push azure master"
`ger [ ~/azure-mol-samples-2nd-ed/03/prod ]$ az webapp deployment source config-local-git --name webappch3 --resource-group azuremolchapter3 -o tsv
/usr/lib64/az/lib/python3.9/site-packages/paramiko/transport.py:236: CryptographyDeprecationWarning: Blowfish has been deprecated
"class": algorithms.Blowfish,
<EMAIL_ADDRESS>ger [ ~/azure-mol-samples-2nd-ed/03/prod ]$ git remote add azure https://github.com/fouldsy/azure-mol-samples-2nd-ed.git
error: remote azure already exists.
ger [ ~/azure-mol-samples-2nd-ed/03/prod ]$ git push azure master
Username for 'https://github.com':
Password for<EMAIL_ADDRESS>remote: Support for password authentication was removed on August 13, 2021.
remote: Please see https://docs.github.com/en/get-started/getting-started-with-git/about-remote-repositories#cloning-with-https-urls for information on currently recommended modes of authentication.
fatal: Authentication failed for 'https://github.com/fouldsy/azure-mol-samples-2nd-ed.git/'`
I have added the keys into my github but not luck yet.
Thoughts? Thanks for your help,

My bad. Got it.


Update logo with the latest .NET

The current logo on the README.md file is the one from the old .Net Framework.
The new one can be found here : https://en.wikipedia.org/wiki/.NET_Framework
Ok, not the most important fix :)

Hello @juchom
Thanks for this issue, every issue, even this tiny one is a contribution for us, thanks 🙂
I will change it asap!


Increase TCP_USER_TIMEOUT to avoid disconnections.

TCP_USER_TIMEOUT value is too small, it is only 4 seconds.
That causes random disconnections reported in the bug report https://github.com/FreeRDP/FreeRDP/issues/2802
This patch should fix the bug https://github.com/FreeRDP/FreeRDP/issues/2802

@volth I think 60 seconds are too high on the other side. This would also mean that network problems (disconnects or so) take longer to be "detected". What do you think about that we use 30 for now and increase if it's still too less?

@freerdp-bot test.

4000 milliseconds is often too small.
I think 60 seconds are too high on the other side.

-> make it configureable by the user / at runtime?!

@abma making it configurable makes perfect sens of course. But there should also be a sane and working default.

@amba @bmiklautz Perhaps "0" would the best choice, in this case "system default" value is used (somehow calculated out of the keep-alive timings). I did not tested it.

i've tested this change: it fixes for me random disconnects of xfreerdp when beeing idle.
idk what would be a reasonable value, but 60s sounds okish, 30s could be to low for wan/vpn connections.

@volth the system default timeout is usually rather long (can be up to 20 minutes and more) which caused hanging connections and such. This was the reasons for adding and using TCP_USER_TIMEOUT in the first place.
@abma finding a good value here isn't that easy. Round trip times for slow connections like gprs are commonly  in the range of 1000ms addin VPN on top doubles or triples them. So the initial choice of 4 seconds even adds up some space (and was tested with a really really slow connection;).
What I wonder is why you are disconnected when idle - I haven't seen this behavior yet. The user timeout should only kick in when the client doesn't receive an ACK for the sent data.  Is there an open issue on that?

i've tested this change: it fixes for me random disconnects of xfreerdp when beeing idle.

sorry, forget that, my test was wrong :-| i tested with an old version of xfreerdp and the cause for the random disconnects was some other bug which seems fixed.

@volth do you have a reproducible test case where 60 seconds are required?

@bmiklautz This timeout is not for the maximum round trip time, it is for the age of the oldest unacknowledged packet. My servers are in ~40ms ping from me, and I use cable modem connection, no mobile, not even WiFi. And with "4000" I have few disconnect per day. Not only when idle. I may work in a RDP session experiencing no lags nor freezes then oops - xfreerdp window is closed.
I consider it is quite normal that there are unacknowledged packets with age of 100 round trip times, even on a good connection.

I'm aware that the timeout is not for the round trip but one need to consider the round trip time as well.. Howsoever my experience showed that if the user time out is hit it is mostly a network problem that's also what your above described behavior indicates for me. If everything works well and you are actively working what's the reason that one acknowledgement all at once take more than 4 seconds (which is hell a lot of time in an active tcp stream if the average round trip time around 40 ms)? For sure the server doesn't need to acknowledge a package immediately but I'd say such a delay is rather uncommon in a properly working environment.
I personally wouldn't like to increase the TCP_USER_TIMEOUT to much as it solved quite some issues when I've added it back then.  So let's set it to 16000  per default and use @abma suggestion and make it configurable. @volth would you be up for that?

Ok, let it be 16000 to close the issue quicker.
As for the future: it does not look convenient if the user would need to configure the timeout beforehand. Especially for the roaming users, who use connections of different quality during the day: fiber optic at the office, wifi at home, 3G on the road... Also, we know appropriate values for our networks, but users may not know them and not willing to know.
Perhaps it would be better to keep the default timeout value around "4000" but not break the connection when the time is over, instead showing a message: "connection issues detected, would you like to close xfreerdp, try to re-connect, wait N seconds more, wait and increase the threshold for the next message and auto-disappear the message if new packets arrived when the message on screen. (At the first glance try to re-connect may look like a good candidate for the only choice, and this is exactly how xfreerdp works with timeout "4000" and +auto-reconnect, but Windows servers often reject new connections when they see the old one is still active; so our trade over the timeout value is actually the trade over the threshold of automated choice between try to re-connect and wait N seconds more when the user cannot express its choice).

@volth did you have the change to analyze you disconnect problem on a package level? It would be really interesting  if there are a rising number of TCP re-transmissions or similar.

I think, yes. I recorded some pcap files with the disconnections. I will have a look.

@volth very nice! Thank you

@volth had any time to have a look into the pcap files?

Superseded by #3015


[SPARK-14399] Remove unnecessary excludes from POMs and simplify Hive POM

This patch aims to simplify our build by removing a number of unnecessary excludes. The individual commit messages describe the changes here in more detail, but there are a few key themes:

Remove many excludes in the root POM: According to the Maven documentation, "dependency management takes precedence over dependency mediation". In many cases, we were both excluding transitive dependencies while also using those dependencies in spark-core and pinning those dependencies' versions in the dependencyManagment section of our POM.
As a rough guideline, I think like we should only exclude dependencies under the following scenarios:

We don't want the dependency at all, in which case we should define a Maven Enforcer rule to ban it.
We want to include some version of the dependency but don't want to explicitly specify a fixed version. For instance, imagine that libraries A and B depend on some dependency C. We might exclude C from library B so that library A's version of C becomes the final effective version.
We want to include the dependency only when certain profiles are enabled, so we ban it from all of our transitive dependencies and explicitly re-add it in a profile.

Remove explicitly-promoted transitive dependencies from Hive POM: in an early revision of #7191, it looks like we tried to use the core-classified version of hive-exec, which is published as a thin-JAR which does not bundle third-party dependencies' classes. However, both the regular and classified versions of the dependency share the same effective POM, which, in this case, happens to be the dependency-reduced-POM produced by the Maven shade plugin. As a result, users of the core-classified JAR must add direct dependencies on what are logically transitive dependencies of hive-exec, so #7191 added several such dependencies in hive/pom.xml.
However, by the end of #7191 we abandoned the idea of using an existing Hive JAR and chose to republish our own JAR, so this promotion of transitive dependencies is no longer necessary.  As a result, this patch was able to significantly cut down the size of the hive POM by removing those direct dependencies. This had the side-effect of exposing a problem where one of our Janino JARs was being pulled to a lower version as a side-effect of this unnecessary dependency promotion.

Use Maven's new wildcard exclude support: Maven now supports wildcard exclusion patterns, so I used that to simplify the exclusion of org.ow2.asm artifacts.

Improve dev/test-dependencies: a bad regex caused the org.spark-project:hive JARs to not be listed under dev/deps; this is now fixed.

Remove joda-time dependency: Spark does not directly depend on joda-time, so I don't think that it makes sense to keep it in our POM.

Remove explicit io.netty dependency: we don't seem to need this anymore. I did leave the dependencyManagement entry for now in order to prevent an unexpected downgrade.

/cc @srowen @steveloughran @vanzin @pwendell @rxin for review.

Oh, /cc @vanzin as well.

A few quick questions:

[ ] Can we remove all of the Guava excludes now? They're all over the place but it's not clear whether it's necessary anymore. If we don't want Guava to appear at all, then I think we should use Enforcer to ban it. Otherwise, I think we should remove the excludes and let dependencyManagement take care of fixing the version.
[ ] Why do we exclude org.mortbay.jetty all over the place? I tried adding an enforcer rule but this proved to be a bit tricky because of how a lot of Hadoop components used in tests seem to depend on it in one way or another.

Test build #54963 has started for PR 12171 at commit 51853c7.

Test build #54963 has finished for PR 12171 at commit 51853c7.

This patch fails to build.
This patch merges cleanly.
This patch adds no public classes.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/54963/
Test FAILed.

Merged build finished. Test FAILed.

[warn] 	module not found: org.pentaho#pentaho-aggdesigner-algorithm;5.1.5-jhyde
[warn] ==== public: tried
[warn]   https://repo1.maven.org/maven2/org/pentaho/pentaho-aggdesigner-algorithm/5.1.5-jhyde/pentaho-aggdesigner-algorithm-5.1.5-jhyde.pom
[warn] ==== Maven2 Local: tried
[warn]   file:/home/sparkivy/per-executor-caches/6/.m2/repository/org/pentaho/pentaho-aggdesigner-algorithm/5.1.5-jhyde/pentaho-aggdesigner-algorithm-5.1.5-jhyde.pom
[warn] ==== local: tried
[warn]   /home/sparkivy/per-executor-caches/6/.ivy2/local/org.pentaho/pentaho-aggdesigner-algorithm/5.1.5-jhyde/ivys/ivy.xml
[warn] 	::::::::::::::::::::::::::::::::::::::::::::::
[warn] 	::          UNRESOLVED DEPENDENCIES         ::
[warn] 	::::::::::::::::::::::::::::::::::::::::::::::
[warn] 	:: org.pentaho#pentaho-aggdesigner-algorithm;5.1.5-jhyde: not found
[warn] 	::::::::::::::::::::::::::::::::::::::::::::::
[warn]
[warn] 	Note: Unresolved dependencies path:
[warn] 		org.pentaho:pentaho-aggdesigner-algorithm:5.1.5-jhyde
[warn] 		  +- org.apache.calcite:calcite-core:1.2.0-incubating
[warn] 		  +- org.spark-project.hive:hive-exec:1.2.1.spark ((com.typesafe.sbt.pom.MavenHelper) MavenHelper.scala#L76)
[warn] 		  +- org.apache.spark:spark-yarn_2.11:2.0.0-SNAPSHOT

It looks like compilation failed because the pentaho-aggdesigner-algorithm transitive dependency isn't present in Maven Central; see also<EMAIL_ADDRESS>This is a great illustration of why Spark's build bans the use of dependencies which aren't present in Maven Central: non-central repos can go offline and break a previously-good build.
I did keep the exclusion which is supposed to be preventing this dep. from being pulled in, so I wonder whether this is a problem specific to the SBT build. Let me try re-running with Maven to see if our POM reader plugin could be to blame.

Jenkins, retest this please

Test build #54967 has started for PR 12171 at commit 51853c7.

Great cleanup!

From the Jenkins Maven output:
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-hive_2.11 ---
Downloading: https://repo1.maven.org/maven2/org/pentaho/pentaho-aggdesigner-algorithm/5.1.5-jhyde/pentaho-aggdesigner-algorithm-5.1.5-jhyde.pom

Downloading: http://www.datanucleus.org/downloads/maven2/org/pentaho/pentaho-aggdesigner-algorithm/5.1.5-jhyde/pentaho-aggdesigner-algorithm-5.1.5-jhyde.pom

Downloading: http://conjars.org/repo/org/pentaho/pentaho-aggdesigner-algorithm/5.1.5-jhyde/pentaho-aggdesigner-algorithm-5.1.5-jhyde.pom
2/2 KB

Downloaded: http://conjars.org/repo/org/pentaho/pentaho-aggdesigner-algorithm/5.1.5-jhyde/pentaho-aggdesigner-algorithm-5.1.5-jhyde.pom (2 KB at 4.0 KB/sec)
Downloading: https://repo1.maven.org/maven2/org/pentaho/pentaho-aggdesigner/5.1.5-jhyde/pentaho-aggdesigner-5.1.5-jhyde.pom

Downloading: http://www.datanucleus.org/downloads/maven2/org/pentaho/pentaho-aggdesigner/5.1.5-jhyde/pentaho-aggdesigner-5.1.5-jhyde.pom

Downloading: http://conjars.org/repo/org/pentaho/pentaho-aggdesigner/5.1.5-jhyde/pentaho-aggdesigner-5.1.5-jhyde.pom
4/9 KB
8/9 KB
9/9 KB

Downloaded: http://conjars.org/repo/org/pentaho/pentaho-aggdesigner/5.1.5-jhyde/pentaho-aggdesigner-5.1.5-jhyde.pom (9 KB at 26.3 KB/sec)
Downloading: https://repo1.maven.org/maven2/org/pentaho/pentaho-aggdesigner-algorithm/5.1.5-jhyde/pentaho-aggdesigner-algorithm-5.1.5-jhyde.jar

Downloading: http://www.datanucleus.org/downloads/maven2/org/pentaho/pentaho-aggdesigner-algorithm/5.1.5-jhyde/pentaho-aggdesigner-algorithm-5.1.5-jhyde.jar

Downloading: http://conjars.org/repo/org/pentaho/pentaho-aggdesigner-algorithm/5.1.5-jhyde/pentaho-aggdesigner-algorithm-5.1.5-jhyde.jar
4/48 KB
7/48 KB
11/48 KB
14/48 KB
17/48 KB
21/48 KB
25/48 KB
29/48 KB
33/48 KB
34/48 KB
38/48 KB
42/48 KB
46/48 KB
48/48 KB

Downloaded: http://conjars.org/repo/org/pentaho/pentaho-aggdesigner-algorithm/5.1.5-jhyde/pentaho-aggdesigner-algorithm-5.1.5-jhyde.jar (48 KB at 99.6 KB/sec)

It looks like our Maven build isn't as strict in its enforcement of only using Maven Central.
I guess maybe Maven will still try to resolve excluded transitive dependencies unless you add an explicit direct dependency? The extra download time by itself isn't a huge deal / that's not necessary what we want to optimize for (otherwise we'd just ban all transitive dependencies and explicitly promote everything to top-level). However, I don't want to rely on clojars so I'll look into restoring that direct dep. on calcite.

org.apache.maven.model.building.ModelBuildingException: 10 problems were encountered while building the effective model for org.apache.spark:spark-hive_2.11:2.0.0-SNAPSHOT
[WARNING] 'dependencies.dependency.exclusions.exclusion.artifactId' for org.spark-project.hive:hive-exec:jar with value '*' does not match a valid id pattern. @ org.apache.spark:spark-parent_2.11:2.0.0-SNAPSHOT, /Users/joshrosen/Documents/spark2/pom.xml, line 1184, column 25

It looks like our custom sbt-pom-reader fork is using an ancient version of Maven which doesn't support this lovely wildcard exclusion syntax. Bummer! Yet another motivation to move back to a stock version; see https://issues.apache.org/jira/browse/SPARK-14401

In fact, being able to use the nice wildcard syntax may be a way's off because the official sbt-pom-reader doesn't support Maven 3.3.x due to API incompatibilities: https://github.com/sbt/sbt-pom-reader/blob/master/project/dependencies.scala#L5

Test build #54971 has started for PR 12171 at commit fc938a0.

Actually, we might be able to use sbt-pom-reader 2.10-RC2, since we only require Maven 3.2.1+ and that artifact uses 3.2.2: https://github.com/sbt/sbt-pom-reader/issues/20#issuecomment-183949295

Test build #54971 has finished for PR 12171 at commit fc938a0.

This patch fails build dependency tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/54971/
Test FAILed.

Test build #54972 has started for PR 12171 at commit 36430de.

Test build #54967 has finished for PR 12171 at commit 51853c7.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/54967/
Test FAILed.

without looking at the details, I appreciated the ambition —and like that wildcard artifact exclusion.
what is the dependency graph that SBT generates from this?
Joda time is an interesting point ... we've seen some problems related to spark + aws having joda time mismatches. the amazon aws/s3/kinesis libs do require joda time, and there was some conflict creeping in there between the hadoop installation and kinesis imports in the spark job.

Test build #54972 has finished for PR 12171 at commit 36430de.

This patch fails from timeout after a configured wait of `250m`.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/54972/
Test FAILed.

It looks like Hive might actually need Joda time:
- analyze MetastoreRelations *** FAILED ***
  org.apache.spark.sql.execution.QueryExecutionException: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. org/joda/time/ReadWritableInstant
  at org.apache.spark.sql.hive.client.HiveClientImpl$$anonfun$runHive$1.apply(HiveClientImpl.scala:455)
  at org.apache.spark.sql.hive.client.HiveClientImpl$$anonfun$runHive$1.apply(HiveClientImpl.scala:440)
  at org.apache.spark.sql.hive.client.HiveClientImpl$$anonfun$withHiveState$1.apply(HiveClientImpl.scala:226)
  at org.apache.spark.sql.hive.client.HiveClientImpl.liftedTree1$1(HiveClientImpl.scala:173)
  at org.apache.spark.sql.hive.client.HiveClientImpl.retryLocked(HiveClientImpl.scala:172)
  at org.apache.spark.sql.hive.client.HiveClientImpl.withHiveState(HiveClientImpl.scala:215)
  at org.apache.spark.sql.hive.client.HiveClientImpl.runHive(HiveClientImpl.scala:440)
  at org.apache.spark.sql.hive.client.HiveClientImpl.runSqlHive(HiveClientImpl.scala:430)
  at org.apache.spark.sql.hive.HiveContext.runSqlHive(HiveContext.scala:351)
  at org.apache.spark.sql.hive.test.TestHiveContext.runSqlHive(TestHive.scala:183)
  ...
01:36:40.566 ERROR hive.ql.exec.DDLTask: java.lang.NoClassDefFoundError: Could not initialize class org.apache.hadoop.hive.serde2.lazy.objectinspector.primitive.LazyPrimitiveObjectInspectorFactory

https://stackoverflow.com/questions/26259717/facing-java-lang-noclassdeffounderror-org-joda-time-readableinstant-error-even

I re-added joda-time; let's see if that fixes Hive.

Test build #55002 has started for PR 12171 at commit 0bb11be.

LGTM if sbt and maven tests pass.

Build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/55026/
Test FAILed.

Test build #55002 has finished for PR 12171 at commit 0bb11be.

This patch fails from timeout after a configured wait of `250m`.
This patch merges cleanly.
This patch adds no public classes.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/55002/
Test FAILed.

Merged build finished. Test FAILed.

Hmm, the FlumePollingStreamSuite test looks broken because it has hung twice now. I'll try to reproduce offline.

@JoshRosen Guava and Jetty excludes might have been done when they were shaded:
https://issues.apache.org/jira/browse/SPARK-2848 - shade Guava
https://issues.apache.org/jira/browse/SPARK-3996 - shade Jetty

Now that we no longer publish assembly JARs for Spark, I don't think that shading is going to require exclusions because the only reason to do that would be if we wanted to completely prevent Jetty and Guava from appearing in our transitive dependency classpath, a task which currently isn't possible unless we republish all of our deps. which depend on Guava and Jetty.


Enforce line item limit

Picking up from the todo here - this adds enforcement for the amount of records that may be imported at a time (as well as a locale for the message returned to the user)
Looks like my text editor added some whitespace changes, you can see the diff without those here.

Looks good. Thanks


Update MapLibre GL Native for Android and other things

Updated Android Gradle Plugin
Update kotlin-android-extensions (and view bindings)
Updated Kotlin
Updated MapLibre GL Native for Android
Removed Style.MAPBOX_STREETS etc., use Style.getPredefinedStyle instead (using MapTiler).

The test app build and runs again. But every activity needs to have a well known tile server set explicitly to function. I only updated the BulkSymbolActivity now. The markers do not appear yet but as soon as that is fixed I would like to merge this.

But every activity needs to have a well known tile server set explicitly to function.

Possibly it might be a good idea to subclass Activity / AppCompatActivity and call Mapbox.getInstance in that new superclass' onCreate?

I only updated the BulkSymbolActivity now. The markers do not appear yet but as soon as that is fixed I would like to merge this.

The problem is here:
https://github.com/maplibre/maplibre-plugins-android/blob/e81c1bbb969150dfd623c9567ae3b2c083b9178d/app/src/main/java/com/mapbox/mapboxsdk/plugins/testapp/activity/annotation/BulkSymbolActivity.java#L158
The icon fire-station-11 is undefined because you changed the map's style. We can add such an icon again and then it will work again :) Here is a patch that uses the fire hydrant icon from Google's material design and gets us the icons back:

@fynngodau Wow thanks with the icon!!
Good catch.


gccgo: compiler crash building map of empty struct type

This file fails to compile with gccgo.  Looks like another zero-sized type problem.  This was actually reduced from a real program, though I have no idea why the program was written that way.
package p
type empty struct{}
func f() {
em := empty{}
v := map[struct{}]int{em: 0}
_ = v
}
go1: internal compiler error: in fold_convert_loc, at fold-const.c:2337
0x82feda fold_convert_loc(unsigned int, tree_node*, tree_node*)
../../trunk/gcc/fold-const.c:2337
0x63e346 Gcc_backend::constructor_expression(Btype*, std::vector<Bexpression*, std::allocator<Bexpression*> > const&, Location)
../../trunk/gcc/go/go-gcc.cc:1675
0x62e011 Struct_construction_expression::do_get_backend(Translate_context*)
../../trunk/gcc/go/gofrontend/expressions.cc:11902
0x62e933 Array_construction_expression::get_constructor(Translate_context*, Btype*)
../../trunk/gcc/go/gofrontend/expressions.cc:12190
0x67be52 Temporary_statement::do_get_backend(Translate_context*)
../../trunk/gcc/go/gofrontend/statements.cc:462
0x6503c5 Block::get_backend(Translate_context*)
../../trunk/gcc/go/gofrontend/gogo.cc:5623
0x651bda Function::build(Gogo*, Named_object*)
../../trunk/gcc/go/gofrontend/gogo.cc:5229
0x65303f Named_object::get_backend(Gogo*, std::vector<Bexpression*, std::allocator<Bexpression*> >&, std::vector<Btype*, std::allocator<Btype*> >&, std::vector<Bfunction*, std::allocator<Bfunction*> >&)
../../trunk/gcc/go/gofrontend/gogo.cc:6941
0x659b53 Gogo::write_globals()
../../trunk/gcc/go/gofrontend/gogo.cc:1281

Fixed by gcc.gnu.org/r219262.


Scope outdated?

The scope for Databricks access described here seems to be no longer valid:
"error_description": "AADSTS1002012: The provided value for scope 2ff814a6-3304-4ab8-85cb-cd0e6f879c1d%2F.default is not valid.

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 34a79d78-8f67-ee0d-71cc-bd34624c674f
Version Independent ID: d993ef52-99c6-0d3c-6d4e-6d84b6c43125
Content: Get Azure AD tokens for service principals - Azure Databricks
Content Source: databricks/dev-tools/api/latest/aad/service-prin-aad-token.md
Service: azure-databricks
GitHub Login: @mssaperla
Microsoft Alias: saperla

@kasuteru
Thanks for your feedback! We will investigate and update as appropriate.

I could have been more precise. There is an ongoing issue that this command simply does not work with cURL (I am not the only one - check the number of requests on Google - lots of people have that problem: https://www.google.com/search?q=following+parameter%3A+grant+type+900144&rlz=1C1GCEB_enDE1018DE1018&oq=following+parameter%3A+grant+type+900144&aqs=chrome..69i57j69i60.7287j0j7&sourceid=chrome&ie=UTF-8)
When trying to run it with Postman (and maybe with cURL as well, I haven't gotten so far yet), the scope needs to be replaced with an actual / instead of the encoding:
Docs example:

What actually works in postman:

@kasuteru
I've delegated this to content author @mssaperla  to review and share his valuable insights.

Thanks for your dedication to our documentation. Unfortunately, we have been unable to review your issue and apologize for the delayed response. The requested updates have not yet been made. The timeline for resolution varies based on resourcing. We've created an internal work item (DOC-7752) to incorporate your suggestions. We are closing this issue for now, but feel free to comment here as necessary.


Want to add TRY FREE page.

Is your feature request related to a problem? Please describe.
I want to add a page in TRY FREE section .
Describe the solution you'd like
In TRY FREE section the user can sign up and start the TRY FREE course.
Describe alternatives you've considered

I want to add some information and data in TRY FREE section.
Additional context
No response
Code of Conduct

[X] I agree to follow this project's Code of Conduct

Pls assign me this work . I want to contribute in your work.

@Nikita110602 Hi, could you explain it more?

Basically, 'Try Free' works with authentication, and it has already been implemented. The only thing that needs to be done is to change the navigation path to the editor page.


Incompatibility with Alex's Mobs

Minecraft version & Mod Version:
MC: 1.20.1
Forge: 47.2.17
CustomGameRules: 1.1.4
Single player or Server:
Single.
Describe problem (what you were doing / what happened):
I punched a crow from Alex's Mobs and the game crashed.
Crash log (if any):
https://mclo.gs/LFwhUgL
(If this is a suggestion and not a bug report, delete all this and just write your suggestion!)
You might want to change the mod name because it's kind of hard to find it in the Curse launcher...

crash report without the other mods: https://mclo.gs/wibKOaX


Why isn't there focus first typeahead support?

In the example of typeahead at this site https://angular-ui.github.io/bootstrap/

@newhereinc This project has nothing to do with Angular UI's typeahead. It's based on Twitter Typeahead.


Consume hooks provided by external lookup

For certain reasons this time I have to paste the below disclaimer:
THIS PROGRAM IS SUBJECT TO THE TERMS OF THE BSD 3-CLAUSE LICENSE.
  THIS SOFTWARE MAY BE REDISTRIBUTED TO OTHERS ONLY BY EFFECTIVELY USING THIS OR
ANOTHER EQUIVALENT DISCLAIMER IN ADDITION TO ANY OTHER REQUIRED LICENSE TERMS.
 NO OTHER SOFTWARE CODE OR MATERIALS ARE A CONTRIBUTION.

LGTM


Omitting escape character in a specific circumstance

Do you want to request a feature or report a bug?
Bug
What is the current behavior?
When creating a style inside a Next.js page, it removes the escape character from a "content" style (Like: e92b instead \e92b). It happened only if I have a require statement on the same style.
If the current behavior is a bug, please provide the steps to reproduce and possibly a minimal demo or testcase in the form of a Next.js app, CodeSandbox URL or similar

function Page() {
   return (

   );
}

It compiles to content: 'e92b':

But, if I remove the "background-image" line, it works as expected (content: '\e92b')
What is the expected behavior?
The compiled CSS return content with escape character like: content: \e92b instead content: e92b.
Environment (include versions)

OS: macOS 10.14.5
Browser: Chrome 76.0.3809.100
styled-jsx (version): 3.2.1
next.js (version): 9.0.5

Did this work in previous versions?
Yes. Using with Next.js 9.0.2 it works as expected.

fixed in #577


[decomp] finish actor-link-h and a few more

Pull Request Test Coverage Report for Build 937584427

3 of 6 (50.0%)  changed or added relevant lines in 5 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage increased (+0.006%) to 69.547%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

decompiler/ObjectFile/ObjectFileDB_IR2.cpp
0
1
0.0%

decompiler/util/data_decompile.cpp
0
2
0.0%

Totals

Change from base Build 934111341:
0.006%

Covered Lines:
36425

Relevant Lines:
52375

💛  - Coveralls


limit size of listing functions

this is done for runs and evals, but should also be done for flows, data and setups. Otherwise php code crashes without proper error msg

Particularly complicated for setup listing, due to the query structure

Fixed for setups. Now only the data, tasks and flows left.

I believe this has been done?

@janvanrijn can you check and close?


Proofreading and copyediting changes made.

What have you Changed(must)
I made a handful of grammatical and spelling changes throughout the README file
Issue no.(must) - #880
Pr will be closed and marked as spam. If issue number not found or issue was assigned to someone else.
Marking as spam can block your account from HacktoberFest.
Self Check(Tick After Making pull Request)

[x] This issue was assigned to me if not it will marked as spam. (I am making the first sweep of changes. This issue is also assigned to @jeslyw)
[x] My file is in proper folder
[x] I am following clean code and Documentation.My code is well linted and I am using flake8 standard for python
[x] I have added title and what program will do first in the file

acknowledgment

[x] I have tested the script and distributed it under an MIT license.

README - How to Contribute

Thanks for making your contributions. It's a really amazing contribution.
you can join us on telegram for more updates about Hacktoberfest. Hacktoberfest Channel:- t.me/hacktober2022
Happy hacktoberfest

Glad I could help! Just as a heads up, it looks like Hacktoberfest is excluding contributions to this repo:

Your PR/MR was submitted to a repository that has been excluded from Hacktoberfest as it does not follow the values of the event. It will not count towards your participation.

Thanks for making your contributions. It's a really amazing contribution.
you can join us on telegram for more updates about Hacktoberfest. Hacktoberfest Channel:- t.me/hacktober2022
Happy hacktoberfest

Glad I could help! Just as a heads up, it looks like Hacktoberfest is excluding contributions to this repo:

Your PR/MR was submitted to a repository that has been excluded from Hacktoberfest as it does not follow the values of the event. It will not count towards your participation.

For the last 2 years, It was included in the Hacktoberfest event. It looks like they have changed some criteria. I just checked

Yeah, it looks like they made some changes this year. Figured you'd want to know!

They are excluding the repo for Algorithm and Data structure this repo.

Yeah, it looks like they made some changes this year. Figured you'd want to know!

AlgorithmsAndDataStructure repo is excluded. The hacktoberfest team is removing the DSA repository.
There is one more repo you can contribute. Please check the below link.
https://github.com/codePerfectPlus/awesomeScripts
Currently, It's included in Hacktoberfest.
@danschenker


⚠ Samsung has degraded performance

In 3ba48d8, Samsung (https://samsung.com) experienced degraded performance:

HTTP code: 200
Response time: 2411 ms

Resolved: Samsung performance has improved in ac002cf.


Does Leader support invert match in fuzzy finding?

Expected behaviour
I found that leaderf rg can do invert match, but can i do invert match in fuzzy finding?

no.

easy to support that? ; is a special character when searching, so a ! could be added to hint a invert match?