Metal API Validation - Video Call

Describe the bug
When using the app in Debug mode on the macOS (Designed for iPad) simulator, if doing video calls, we get an error and the app crashes. This error can be avoided by deactivating METAL API Validation in the Run app Build Diagnostics; however, this doesn't seem like a good idea. Could you please investigate what might be causing this bug?
SDK Version
2.0.5
iOS/macOS Version
MacOS 14.5
Steps to Reproduce
Start a video call on MacOS using designed for iPad target.
Expected behavior
It should not be necessary to deactivate Metal API Validation to do video calls in Debug mode on simulators.
Screenshots
N/A
Logs
2024-05-27T09:16:53+0100 info LiveKitSDK : [LiveKit] CameraCapturer.init(delegate:options:) isMultitaskingAccessSupported: false
2024-05-27T09:16:53+0100 info LiveKitSDK : [LiveKit] LocalParticipant.publish(track:options:) [publish] LocalVideoTrack(sid: nil, name: camera, source: Source(rawValue: 1)) options: nil...
[C:1-4] Error received: Invalidated by remote connection.
CMIO_DAL_CMIOExtension_Stream.mm:1472:GetPropertyData wrong data size for kCMIOStreamPropertyCenterStageFramingMode
CMIOHardware.cpp:331:CMIOObjectGetPropertyData Error: 561211770, failed
Fig assert: "err == 0 " at bail (CMIOUtilities.h:133) - (err=561211770)
CMIO_DAL_CMIOExtension_Stream.mm:1472:GetPropertyData wrong data size for kCMIOStreamPropertyCenterStageFramingMode
CMIOHardware.cpp:331:CMIOObjectGetPropertyData Error: 561211770, failed
Fig assert: "err == 0 " at bail (CMIOUtilities.h:133) - (err=561211770)
2024-05-27T09:16:53+0100 info LiveKitSDK : [LiveKit] CameraCapturer.startCapture() starting camera capturer device: <AVCaptureFigVideoDevice: 0x135867a00 [FaceTime HD Camera][3F45E80A-0176-46F7-B185-BB9E2C0E82E3]>, format: (format: 'vide'/'420v' 1280x 720, {15- 30 fps}, photo dims:{1280x720}, max zoom:45.00 (upscales @1.00), ISO:50.0-50.0, supports multicam, supports Portrait Effect, supports Studio Lighting, supports Reactions, dimensions: Dimensions(1280x720)), fps: 30(0...30)
<<<< FigCaptureCameraParameters >>>> Fig assert: "success" at bail (FigCaptureCameraParameters.m:250) - (err=0)
<<<< FigCaptureCameraParameters >>>> Fig assert: "success" at bail (FigCaptureCameraParameters.m:250) - (err=0)
|__ fsbp_Autofocus ___| Fig assert: "err == noErr" at bail (FigSampleBufferProcessor_Autofocus.m:2484) - (err=0)
-[MTLDebugDevice newTextureWithDescriptor:iosurface:plane:]:2641: failed assertion `Texture Descriptor Validation
IOSurface textures must use MTLStorageModeShared

This is probably fixed, can you try main branch ?

Hello, I have tested the main branch and am still experiencing the same behavior.

@raphaelalkamim do you have a way for us to reproduce this issue? Are you able to repro with the example app?
If not, could you attach a example project where we could repro?

Ok I can confirm this, Investigating...
"Mac Catalyst" > OK
"Designed for iPad" > Crashes.

https://forums.developer.apple.com/forums/thread/710843

This looks like a bug in Apple's Portrait mode related code. I don't think we can fix this at the moment.
The workaround is to disable Metal validation...


Add Bulgarian translation entries

Got inspired by looking at recent PRs (thanks to #5429).
Bulgarian is close to the Russian language entries, but is just different enough to contribute this PR.

Thanks!


Better Use Of Space (Left Nav: Languages, Pinned, Tags etc)

The more we know about your system and use case, the more easily and likely we can help.
Environment info
*Windows 10 - 64 bit

Lepton v1.9.0
*Display: 1920x1080 at 150%

Description of the problem / feature request / question:
On my 2 in 1 14-inch Lenovo Yoga Laptop the display is zoomed 150% for best display and Lepton's left nav/column is a bit frustrating - I think some of info there is already available in top menu anyway (new and sync) and the rest could be removed or relocated to free up some space. The languages section for example only shows three languages by defaul without having to scroll - It's minor, but thought I'd share FYI.
If possible, provide a sample gist or screenshot:
Screenshot: https://www.webspectrum.co.uk/lepton.png
If possible, provide the log files

Mac: ~/Library/Application Support/Lepton/logs
Windows: C:\Users\<username>\AppData\Roaming\Lepton\logs
Linux: ~/.cached/Lepton/logs

The debug mode is recommended when producing the logs.
You can send your log file to<EMAIL_ADDRESS>if don't want to post it here.

Thanks for the feedback. Though not exactly match your need, the profile picture can be hidden by adding
    "userPanel": {
        "hideProfilePhoto": true
    }

to .leptonrc configuration file.
https://gist.github.com/hackjutsu/1ad7e4968eb64d881ec9dedd6c0f400b

If you are interested, feel free to play with the code and add options in userPanel to hide other section as well.

Thanks, and I hadn't realised languages, pinned and tagged sections can be expanded/collapsed too - so that actually helps a lot on smaller screens.


[stable/mysql] Update mysql user passwords on secrets change

If you don't specify MySQL root and other users passwords they are auto-generated. However, if you run the Helm upgrade the new auto-generated secrets will become invalid. With this fix, it will be possible to change user-specified password also on Helm upgrade.

/assign @scottrigby

/ok-to-test

/retest

/lgtm

/assign @scottrigby

Thanks @komljen I was looking for this exact feature.

@viglesiasce Do we really want to do this? We have this problem with all charts that auto-generate passwords. IMHO you should always set a password explicitly for purposes other then simple testing. Alternatively, there's the --reuse-values flag for helm upgrade. Automatically changing passwords on upgrade is not something I would expect.
/hold

IMHO you should always set a password explicitly for purposes other then simple testing.

I agree on this one, but when I tried this chart for the first time I got confused why my apps started to fail after I did the upgrade of umbrella chart where mysql was a dependency. I think that Jenkins chart is changing the password on upgrade if not set also.

@unguiculus is --reuse-values really an alternative for this issue?
I have tested it like this:
helm upgrade --install mysql stable/mysql --set imageTag=5.7.10 --set persistence.enabled=false --reuse-values
kubectl exec $(kubectl get pods -l app=mysql-mysql -o jsonpath='{.items[0].metadata.name}') env | grep PASSWORD

helm upgrade --install mysql stable/mysql --set imageTag=5.7.11 --set persistence.enabled=false --reuse-values
kubectl exec $(kubectl get pods -l app=mysql-mysql -o jsonpath='{.items[0].metadata.name}') env | grep PASSWORD

which shows that passwords are re-randomized between both deploys. It would make sense since when the password is not set, the randAlphNum doesn't save its output to values no?

Good point, but if we specify our own password and then we want to change it, we could just use --set with helm upgrade and our mysql would have a new password.

Created existingSecret option as an alternative solution - #5783

This pull request solves the problem of updating the password with helm upgrade command. It doesn't matter if the password is auto-generated or set by the user.

What prevented this from being merged?

Bumping up @benlangfeld question, that would be really nice to have feature in a chart

Just in case someone has same issue, it is possible to make exact this thing using extraContainers, extraVolumeMounts etc. below example how to parametrize a chart:
`args: [ "--init-file=/tmp/files/mysql-init" ]
#Update database credentials with newly generated ones in secret
#1. Create initialization script
#2. Write env variables to that initization script and write it to shared volume
#3. Adds extra argument to get init file from shared volume!
initializationFiles:
mysql-init: |-
UPDATE mysql.user SET authentication_string = PASSWORD('MYSQL_ROOT_PASSWORD')
WHERE User = 'root' AND Host = '%';
UPDATE mysql.user SET authentication_string = PASSWORD('MYSQL_PASSWORD')
WHERE User = 'MYSQL_USER' AND Host = '%';
FLUSH PRIVILEGES;
extraInitContainers: |

name: "update-mysql-init"
image: "busybox:1.25.0"
imagePullPolicy: {{ .Values.imagePullPolicy | quote }}
command: [
"sh",
"-ce",
"cp /docker-entrypoint-initdb.d/mysql-init /tmp/files/mysql-init &&
sed -i "s/MYSQL_ROOT_PASSWORD/$MYSQL_ROOT_PASSWORD/g" /tmp/files/mysql-init &&
sed -i "s/MYSQL_PASSWORD/$MYSQL_PASSWORD/g" /tmp/files/mysql-init &&
sed -i "s/MYSQL_USER/$MYSQL_USER/g" /tmp/files/mysql-init" ]
env:

name: MYSQL_ROOT_PASSWORD
valueFrom:
secretKeyRef:
name: {{ template "mysql.fullname" . }}
key: mysql-root-password
name: MYSQL_PASSWORD
valueFrom:
secretKeyRef:
name: {{ template "mysql.fullname" . }}
key: mysql-password
volumeMounts:
name: migrations
mountPath: /docker-entrypoint-initdb.d
name: tmp-files
mountPath: /tmp/files

extraVolumes: |

name: tmp-files
emptyDir: {}

extraVolumeMounts: |

name: tmp-files
mountPath: /tmp/files`

@Tarjei400 's solution did not work for me, perhaps because I was using a persistent volume.
Instead, I:

Noted the current secrets being used for the mysql root and user (if you have a different one)
Updated the secrets
Restarted the pods (so the env vars updated)
port-forwarded the mysql pod
connected a local mysql client to the pod (using previously noted credentials of root user)
used the mysql client to update the passwords
ALTER USER 'userName'@'localhost' IDENTIFIED BY 'New-Password-Here';


[AIFlow][Refactor] Remove notification service in aiflow

What is the purpose of the change
Notification service has been extracted as a standalone package. We should remove the staled notification service in AIFlow.
Brief change log
Remove notification service.
Verifying this change
This change is already covered by existing tests

There's a comment in notification.py should be changed as well. Others LGTM

There's a comment in notification.py should be changed as well. Others LGTM

Good catch! It has been fixed in f1e3a4f.


Replace fixed height with min-height on textarea

By replacing the fixed height property with min height, it allows the html textarea 'rows' attribute to be honored if provided as a prop. Previously, the height constraint caused the textarea to remain fixed, even if a rows prop was provided.

We fixed this I believe. Thanks for your help with the PR though. Appreciate it.


refactor: do not bind class methods

I think this is mostly a question of style, but it seems that the current code is unnecessarily eye-catching and unexpected to the majority.

For the record, the intention of this question was not to argue for or against binding instance methods. It was simply to understand why we need to bind methods, ie. to see an explanation like https://github.com/statechannels/statechannels/commit/7a9689fd13ad12dca97c8777208859fa7407db94#r43705018
A comment such as
    /*
    Binding methods to the class instance makes it slightly easier to use class methods in callbacks.
    If we don't bind methods to the class instance, than this results in a runtime error, due to the semantics
    of the `this` keyword in javascript:
    `channelResults.map(this.registerChannelWithChainService)`

    By calling
    `this.registerChannelWithChainService = this.this.registerChannelWithChainService.bind(this)`
    in the method constructor, `channelResults.map(this.registerChannelWithChainService)` works as a developer
    might expect.

    For further context, see eg. https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Global_objects/Function/bind
    */

living in the code would make it clear to a developer why methods are bound as such.


Support rules in org tables

Org tables are supported but the horizontal rules in them are not.
#+TITLE: My Hugo Blog Post in Org
#+DATE: 2017-02-13
#+DRAFT: true

* Org table
|---+---+---|
| a | b | c |
|---+---+---|
| d | e | f |
|---+---+---|

I confirm the fix :+1:


Add command to sign a withdrawal credentials update message using a validator keystore

There is a cohort of users who have lost or are missing their mnemonic and are unable to update their withdrawal credentials. As of now, these funds are locked permanently and indefinitely. We have a potential solution that can allow these users to regain their funds though we have no approval or proper implementation. One of the necessary components of this solution is a signature from the validator keystore that can be used as a proof of ownership of the validator.  This adds the ability for a user to generate said signature.
The users runs generate-bls-to-execution-change-keystore with the provided keystore, password, validator index, and designed execution address to update their withdrawal credentials with.  This command outputs and signature json file where the message will contain the provided execution address and validator index.

I'm thinking about changing the logic to be a more generic "sign message with validator keystore"...

It would be nice if you could link the related proposals if they exist in a draft or a working document somewhere else.

It would be nice if you could link the related proposals if they exist in a draft or a working document somewhere else.

The only location for the proposal right now is https://github.com/eth-educators/update-credentials-without-mnemonic
If we are in agreement, my plan would be to get this landed (when ready) and create a new release. I'll then update the other repo with the new instructions and then we can broadcast to determine interest.

Do you want the logic as-is in here, or do you prefer the more generic "sign message" logic?

After some thought I'd prefer to keep it as is.
The generic signing came as an idea with the Stakers Union project where you have to turn off your validator to prove ownership. My thought was signing the Stakers Union's Oath with the validator keystore would do just as well.
But I am also of the opinion that any form of generic signing is dangerous. This needs to be a highly secure project based on the operations. I would rather build out a separate command for that use case if the need arises.

OK, I agree. I am interested in seeing this in. Even if we end up backing it out again, if there’s just not appetite to actually do this, from the Ethereum devs.
Let’s see what Remy says when he’s back next week.

I wish there was more efforts into bringing this as an official EIP and gathering comments and reviews from peers in the ecosystem. I'm happy to review this PR and include it in the project but I fear it will not be used if the principles and the specs behind this feature isn't accepted at the protocol level.

We’d include this to gauge interest and see how many people are impacted. That’s how we get the protocol on board. Chicken and egg.
At some point it’ll be removed again.


Support required keyword

Highlight the keyword required.
Currently the keyword required is not supported, and shows an error message:
Field Label 'required' is not allowed.

Required fields are not supported in proto3.

https://developers.google.com/protocol-buffers/docs/proto3

Thanks @kshchepanovskyi


Xerces version 2.7.1 in JDK8

Unsure where to raise something? Here are some of the common places:

If your issue is due to the way OpenJDK is built, then this is the repository to raise it in - Describe your problem below
If your issue is related to our installers (as opposed to tgz/zip downloads) raise it in installer
If your issue is related to and end-user visible issue with the JDK, or an underlying java bug, please raise it in adoptium-support

Problem description:
Xerces version 2.7.1 in JDK8
Hi Team, I was just checking xerces version used in jdk8u362 version and i found out that it is 2.7.1.
I got one link where xerces was upgraded to 2.12.1 - https://bugs.openjdk.org/browse/JDK-8260568
but its still showing 2.7.1 for me. Please do check it.

I decompiled rt.jar and found out version is 2.7.1. I think issue number JDK-8260568 is not fixed.

@ashirvadgupta The Xerces shipped with Java 8 is pinned to that older version for compatibility changes and won't be changed.

@karianna but this is vulnerable right?

It's an internal version that can't be reached from user code.


Feature request: date component orders

I feel bad opening what appears to be the first issue, so...
First up, thank you: this is pretty close to exactly the component I was looking for.
That said, please could you consider a way to reorder the date components?
As an example:
    dateFormat:
      weekday: long
      day: 2-digit
      month: long

renders out as:
Tuesday, June 22
I would like to rearrange it to be "Tuesday, 22 June" (call it a regional/localization issue... )
Thanks!

This is now possible by setting dateFormat to a string.
Please refer the following documentation to setup your prefered format: https://moment.github.io/luxon/docs/manual/formatting.html#toformat


Unable to train NER using custom ELMO embedding model

I have trained my own Chemical based ELMO embedding model. I have used default options for training elmo expect the "max_characters_per_token": 25 (default value is 50). I have both the hdf5 file and option file. This is how my options.json looks like.
"{"bidirectional": true, "char_cnn": {"activation": "relu", "embedding": {"dim": 16}, "filters": [[1, 32], [2, 32], [3, 64], [4, 128], [5, 256], [6, 512], [7, 1024]], "max_characters_per_token": 25, "n_characters": 262, "n_highway": 2}, "dropout": 0.1, "lstm": {"cell_clip": 3, "dim": 4096, "n_layers": 2, "proj_clip": 3, "projection_dim": 512, "use_skip_connections": true}, "all_clip_norm_val": 10.0, "n_epochs": 10, "n_train_tokens": 684095660, "batch_size": 256, "n_tokens_vocab": 6426860, "unroll_steps": 20, "n_negative_samples_batch": 8192}"
When I try to run the command "python nerTagger.py --architecture BidLSTM_CNN_CRF --use-ELMo --embedding word2vec train" I get the following error. However if I try with default ELMO model, training completes successfully.
>>python nerTagger.py --architecture BidLSTM_CNN_CRF --use-ELMo --embedding word2vec train

Using TensorFlow backend.
/opt/conda/lib/python3.6/site-packages/tensorflow/python/framework/dtypes.py:516: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_qint8 = np.dtype([("qint8", np.int8, 1)])
/opt/conda/lib/python3.6/site-packages/tensorflow/python/framework/dtypes.py:517: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_quint8 = np.dtype([("quint8", np.uint8, 1)])
/opt/conda/lib/python3.6/site-packages/tensorflow/python/framework/dtypes.py:518: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_qint16 = np.dtype([("qint16", np.int16, 1)])
/opt/conda/lib/python3.6/site-packages/tensorflow/python/framework/dtypes.py:519: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_quint16 = np.dtype([("quint16", np.uint16, 1)])
/opt/conda/lib/python3.6/site-packages/tensorflow/python/framework/dtypes.py:520: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_qint32 = np.dtype([("qint32", np.int32, 1)])
/opt/conda/lib/python3.6/site-packages/tensorflow/python/framework/dtypes.py:525: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  np_resource = np.dtype([("resource", np.ubyte, 1)])
/opt/conda/lib/python3.6/site-packages/tensorboard/compat/tensorflow_stub/dtypes.py:541: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_qint8 = np.dtype([("qint8", np.int8, 1)])
/opt/conda/lib/python3.6/site-packages/tensorboard/compat/tensorflow_stub/dtypes.py:542: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_quint8 = np.dtype([("quint8", np.uint8, 1)])
/opt/conda/lib/python3.6/site-packages/tensorboard/compat/tensorflow_stub/dtypes.py:543: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_qint16 = np.dtype([("qint16", np.int16, 1)])
/opt/conda/lib/python3.6/site-packages/tensorboard/compat/tensorflow_stub/dtypes.py:544: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_quint16 = np.dtype([("quint16", np.uint16, 1)])
/opt/conda/lib/python3.6/site-packages/tensorboard/compat/tensorflow_stub/dtypes.py:545: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_qint32 = np.dtype([("qint32", np.int32, 1)])
/opt/conda/lib/python3.6/site-packages/tensorboard/compat/tensorflow_stub/dtypes.py:550: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  np_resource = np.dtype([("resource", np.ubyte, 1)])
WARNING:tensorflow:From /home/developer/deep_learning/workspace/NLP_PROJECTS/CAS_POC_NER/delft/delft-master/delft/sequenceLabelling/preprocess.py:24: The name tf.set_random_seed is deprecated. Please use tf.compat.v1.set_random_seed instead.

WARNING:tensorflow:From /home/developer/deep_learning/workspace/NLP_PROJECTS/CAS_POC_NER/delft/delft-master/delft/utilities/bert/optimization.py:87: The name tf.train.Optimizer is deprecated. Please use tf.compat.v1.train.Optimizer instead.

Loading data...
/home/developer/.local/lib/python3.6/site-packages/numpy/core/_asarray.py:83: VisibleDeprecationWarning: Creating an ndarray from ragged nested sequences (which is a list-or-tuple of lists-or-tuples-or ndarrays with different lengths or shapes) is deprecated. If you meant to do this, you must specify 'dtype=object' when creating the ndarray
  return array(a, dtype, copy=False, order=order)
5 train sequences
         nb. tokens 31
         with nb. entities 13
1 validation sequences
         nb. tokens 2
         with nb. entities 2

6 total sequences
33 total tokens

total distinct characters: 23

init ELMo
WARNING:tensorflow:From /home/developer/deep_learning/workspace/NLP_PROJECTS/CAS_POC_NER/delft/delft-master/delft/utilities/Embeddings.py:352: The name tf.placeholder is deprecated. Please use tf.compat.v1.placeholder instead.

WARNING:tensorflow:From /home/developer/deep_learning/workspace/NLP_PROJECTS/CAS_POC_NER/delft/delft-master/delft/utilities/Embeddings.py:354: The name tf.variable_scope is deprecated. Please use tf.compat.v1.variable_scope instead.

WARNING:tensorflow:From /home/developer/deep_learning/workspace/NLP_PROJECTS/CAS_POC_NER/delft/delft-master/delft/utilities/Embeddings.py:354: The name tf.AUTO_REUSE is deprecated. Please use tf.compat.v1.AUTO_REUSE instead.

WARNING:tensorflow:From /home/developer/deep_learning/workspace/NLP_PROJECTS/CAS_POC_NER/delft/delft-master/delft/utilities/bilm/model.py:332: The name tf.get_variable is deprecated. Please use tf.compat.v1.get_variable instead.

WARNING:tensorflow:From /home/developer/deep_learning/workspace/NLP_PROJECTS/CAS_POC_NER/delft/delft-master/delft/utilities/bilm/model.py:377: The name tf.nn.max_pool is deprecated. Please use tf.nn.max_pool2d instead.

WARNING:tensorflow:From /opt/conda/lib/python3.6/site-packages/tensorflow/python/util/dispatch.py:180: calling squeeze (from tensorflow.python.ops.array_ops) with squeeze_dims is deprecated and will be removed in a future version.
Instructions for updating:
Use the `axis` argument instead
Traceback (most recent call last):
  File "/opt/conda/lib/python3.6/site-packages/tensorflow/python/framework/ops.py", line 1864, in _create_c_op
    c_op = c_api.TF_FinishOperation(op_desc)
tensorflow.python.framework.errors_impl.InvalidArgumentError: Can not squeeze dim[2], expected a dimension of 1, got 26 for 'en/bilm/CNN/Squeeze' (op: 'Squeeze') with input shapes: [?,?,26,32].

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "nerTagger.py", line 603, in <module>
    data_path=data_path)
  File "nerTagger.py", line 63, in train
    use_BERT=use_BERT)
  File "/home/developer/deep_learning/workspace/NLP_PROJECTS/CAS_POC_NER/delft/delft-master/delft/sequenceLabelling/wrapper.py", line 95, in __init__
    self.embeddings = Embeddings(embeddings_name, use_ELMo=use_ELMo, use_BERT=use_BERT)
  File "/home/developer/deep_learning/workspace/NLP_PROJECTS/CAS_POC_NER/delft/delft-master/delft/utilities/Embeddings.py", line 88, in __init__
    self.make_ELMo()
  File "/home/developer/deep_learning/workspace/NLP_PROJECTS/CAS_POC_NER/delft/delft-master/delft/utilities/Embeddings.py", line 356, in make_ELMo
    self.embeddings_op = self.bilm(self.character_ids)
  File "/home/developer/deep_learning/workspace/NLP_PROJECTS/CAS_POC_NER/delft/delft-master/delft/utilities/bilm/model.py", line 99, in __call__
    max_batch_size=self._max_batch_size)
  File "/home/developer/deep_learning/workspace/NLP_PROJECTS/CAS_POC_NER/delft/delft-master/delft/utilities/bilm/model.py", line 280, in __init__
    self._build()
  File "/home/developer/deep_learning/workspace/NLP_PROJECTS/CAS_POC_NER/delft/delft-master/delft/utilities/bilm/model.py", line 284, in _build
    self._build_word_char_embeddings()
  File "/home/developer/deep_learning/workspace/NLP_PROJECTS/CAS_POC_NER/delft/delft-master/delft/utilities/bilm/model.py", line 389, in _build_word_char_embeddings
    embedding = make_convolutions(self.char_embedding)
  File "/home/developer/deep_learning/workspace/NLP_PROJECTS/CAS_POC_NER/delft/delft-master/delft/utilities/bilm/model.py", line 383, in make_convolutions
    conv = tf.squeeze(conv, squeeze_dims=[2])
  File "/opt/conda/lib/python3.6/site-packages/tensorflow/python/util/dispatch.py", line 180, in wrapper
    return target(*args, **kwargs)
  File "/opt/conda/lib/python3.6/site-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
    return func(*args, **kwargs)
  File "/opt/conda/lib/python3.6/site-packages/tensorflow/python/ops/array_ops.py", line 3162, in squeeze
    return gen_array_ops.squeeze(input, axis, name)
  File "/opt/conda/lib/python3.6/site-packages/tensorflow/python/ops/gen_array_ops.py", line 9666, in squeeze
    "Squeeze", input=input, squeeze_dims=axis, name=name)
  File "/opt/conda/lib/python3.6/site-packages/tensorflow/python/framework/op_def_library.py", line 788, in _apply_op_helper
    op_def=op_def)
  File "/opt/conda/lib/python3.6/site-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
    return func(*args, **kwargs)
  File "/opt/conda/lib/python3.6/site-packages/tensorflow/python/framework/ops.py", line 3616, in create_op
    op_def=op_def)
  File "/opt/conda/lib/python3.6/site-packages/tensorflow/python/framework/ops.py", line 2027, in __init__
    control_input_ops)
  File "/opt/conda/lib/python3.6/site-packages/tensorflow/python/framework/ops.py", line 1867, in _create_c_op
    raise ValueError(str(e))
ValueError: Can not squeeze dim[2], expected a dimension of 1, got 26 for 'en/bilm/CNN/Squeeze' (op: 'Squeeze') with input shapes: [?,?,26,32].

Also just to verify whether "max_characters_per_token": 25 is creating error, I tried changing "max_characters_per_token": 25 to 50 in options.json file and train completed fully. So somewhere inside the code, "max_characters_per_token=50" is hardcoded. But unable to find the exact location.
Please note that all library versions are in line with requirement.txt. Any help is greatly appreciated.

In embedding.py, make_elmo() function, in line no. 346 and 352, the max character length of 50 is hard coded. I changed it to 25 and the below error is rectified.


System error - Illegal offset type

Hello,
we are experiencing a problem after upgrading to 10.2.8 from 10.2.7 for ECS:
./vendor/bin/ecs check --debug --config ecs.php
 [ERROR] System error: "Fixing of
         "src/......./Update.php" file by
         "Symplify\CodingStandard\Fixer\LineLength\LineLengthFixer" failed:
         Illegal offset type in file
         /builds/xxx/vendor/symplify/e
         asy-coding-standard/vendor/symplify/coding-standard/src/TokenRunner/Ana
         lyzer/FixerAnalyzer/BlockFinder.php on line 43"
         Run ECS with "--debug"
         option and post the report here:
         https://github.com/symplify/symplify/issues/new in
         src/......./Update.php:182

Check is failing only in our CI, no error on local.
There is no error to fix in the file in the 10.2.7 version and in the 10.2.8 on local.
The file Update.php has only 17 rows.

We'll need failing test case to reproduce.

Works, thank you.

Next time, please provide a fixture, so we can fix it sooner :)

I wanted, but I was not able to reproduce this error on my local, it fails only in CI. Still not understand why :)

Depends how your CI differs from local :) PHP version, Docker setup, extensions, OS, way to install packages.


Yank/cut operations aren't inclusive with 'virtualedit=onemore' and 'selection=old'

Hello.
Steps to reproduce:

Start vim like this: vim -N -u NONE
Execute set virtualedit=onemore selection=old
Enter Insert mode and type some text, e.g. Test string. Leave Insert mode.
Position the cursor at the start of the line you've just typed.
Execute v$l. The whole line together with EOL character is selected.
Execute yP

Expected results:
Test string
Test string

Actual results:
Test stringTest string

As stated by docs, selection=old should be inclusive, but it isn't in the case described above.
Please fix.

$ vim --version
VIM - Vi IMproved 7.4 (2013 Aug 10, compiled Aug 22 2016 16:55:30)
Included patches: 1-2239
Modified by Gentoo-9999
Compiled by coacher@Photon
Huge version without GUI.  Features included (+) or not (-):
+acl             +file_in_path    +mouse_sgr       +tag_old_static
+arabic          +find_in_path    -mouse_sysmouse  -tag_any_white
+autocmd         +float           +mouse_urxvt     -tcl
-balloon_eval    +folding         +mouse_xterm     +termguicolors
-browse          -footer          +multi_byte      +terminfo
++builtin_terms  +fork()          +multi_lang      +termresponse
+byte_offset     +gettext         -mzscheme        +textobjects
+channel         -hangul_input    -netbeans_intg   +timers
+cindent         +iconv           +num64           +title
+clientserver    +insert_expand   +packages        -toolbar
+clipboard       +job             +path_extra      +user_commands
+cmdline_compl   +jumplist        -perl            +vertsplit
+cmdline_hist    +keymap          +persistent_undo +virtualedit
+cmdline_info    +lambda          +postscript      +visual
+comments        +langmap         +printer         +visualextra
+conceal         +libcall         +profile         +viminfo
+cryptv          +linebreak       +python/dyn      +vreplace
-cscope          +lispindent      +python3/dyn     +wildignore
+cursorbind      +listcmds        +quickfix        +wildmenu
+cursorshape     +localmap        +reltime         +windows
+dialog_con      +lua             +rightleft       +writebackup
+diff            +menu            -ruby            +X11
+digraphs        +mksession       +scrollbind      +xfontset
-dnd             +modify_fname    +signs           -xim
-ebcdic          +mouse           +smartindent     -xpm
+emacs_tags      -mouseshape      +startuptime     +xsmp_interact
+eval            +mouse_dec       +statusline      +xterm_clipboard
+ex_extra        -mouse_gpm       -sun_workshop    -xterm_save
+extra_search    -mouse_jsbterm   +syntax
+farsi           +mouse_netterm   +tag_binary
   system vimrc file: "/etc/vim/vimrc"
     user vimrc file: "$HOME/.vimrc"
 2nd user vimrc file: "~/.vim/vimrc"
      user exrc file: "$HOME/.exrc"
       defaults file: "$VIMRUNTIME/defaults.vim"
  fall-back for $VIM: "/usr/share/vim"
Compilation: x86_64-pc-linux-gnu-gcc -c -I. -Iproto -DHAVE_CONFIG_H     -O2 -march=native -mfpmath=sse -fomit-frame-pointer -pipe -frecord-gcc-switches -Wimplicit-function-declaration -U_FORTIFY_SOURCE -D_FORTIFY_SOURCE=1
Linking: x86_64-pc-linux-gnu-gcc   -Wl,--hash-style=gnu -Wl,-O1 -L/usr/local/lib -Wl,--as-needed -o vim    -lSM -lICE -lXpm -lXt -lX11 -lXdmcp -lSM -lICE  -lm -lncurses -lnsl    -lacl -lattr -ldl  -L/usr/lib -lluajit-5.1

This is not a bug.  Setting 'selection' to "old" means the following newline is not included.  Whether 'visualedit' allows moving the cursor past the end is not changing that.    I'll add a remark to the docs.


Increase telegram size

In Lithuania, energy provider uses energy meter Sagemcom T211 it sends more data than maximum size of 2048 bytes currently specified. Double the maximum telegram size to 4096.

Interesting! Is the longer messages because there are more sensors available? Would it make sense to add these to the yaml file?
I am thinking that it might be better to allocate the buffer dynamically and ideally in some smart way where the required size is determined automatically. Not sure how that would work though. I will think about it.

Yes, there is more sensors, all data that is provided to us is here:
https://www.eso.lt/download/523006/p1 sąsajos duomenų modelis.pdf

I have given this some thought and I would like to increase the buffer size dynamically instead of setting a fixed size which will be unnecessarily large for most. But before implementing this I will add some timeouts so the buffer wont grow uncontrollably in case of a communication error.
I hope to have some time for this during the christmas holidays.


improved/removed deprecated code

ExtractorRegistry->getInstance()  will be removed in TYPO3 v12.0. Deprecation warning solved

Thank you :)


Setup unit tests

Setup Jest with coverage output and turn Travis back on

Unit tests are working and Codecov seems to be digesting the coverage report. Was a lot simpler than I imagined.


Do Honey bottles contain 250 mB of honey or 333 1/3 mB?

Describe the Bug
In https://github.com/MehVahdJukaar/amendments/issues/81 @MehVahdJukaar told me that all bottles contain 333 1/3 mB on Fabric liquid. Does this also apply to honey bottles? Because you can empty them for 250 mB, but you get 333 1/3 mB of honey if you pump it from a bees nest. Is this simply to make Ceate more effective than Vanilla Metoden (like shaft cutting is more effective than shaft crafting) or do you still have the Forge system?
Also, at 333 1/3 mB per bottle, you couldn't make honey blocks liquid anymore, as this consists of 4 * 333 1/3 mB = 1333 1/3 mB. So it would be nice if you could either give bottles 333 1/3 mB when spouting/emptying or if you could put 4 honey bottles in a cauldron, even if this would require either a new cauldron type or a layer 0 in the fluid cauldron exclusively for honey.
Reproduction Steps
Otherwise there is a dublication glitch:

fill a basin with a bucket
take out 4 bottles of honey
put three bottles of it into a cauldron
take the honey out again with a bucket. You have made an extra honey bottle.

Expected Result
Standardised fluid quantities.
Screenshots and Videos
No response
Crash Report or Log
No response
Operating System
Windows 11
Mod Version
0.5.1f
Minecraft Version
1.20.1
Other Mods
No response
Additional Context
No response

To add onto this the unit of a bottle would be, as defined in FluidConstants.BOTTLE_AMOUNT, 27000 fabric fluid units

Honey bottles need to use 1/4 instead of 1/3 as vanilla defines 1 block as 4 bottles.

but that's only because of forge limitations, otherwise 1 block of honey could be defined as made of 4/3mb... or do i miss something?

4 bottles -> 1 block is a vanilla recipe

i understand both these things. so i must be missing something.  why should a block of honey correspond to a bucket of honey?

I see; but this is not a vanilla standard. so are we not back pointing the finger at forge?
thank you for humoring me. i appreciate the explanation.

I was only thinking of a honey cauldron because the fluid cauldrons (Admendments) in fabric only have three block states and would need a fourth for honey. @MehVahdJukaar, you could also make it that honey is also allowed in the fluid cauldron and then, unlike the other liquids, fills it completely to the edge.

so are we not back pointing the finger at forge
No, vanilla minecraft! Sometimes it matches Forge (honey bottles), sometimes Fabric (water bottles)...

so are we not back pointing the finger at forge

No, vanilla minecraft! Sometimes it matches Forge (honey bottles), sometimes Fabric (water bottles)...

so are we not back pointing the finger at forge

No, vanilla minecraft! Sometimes it matches Forge (honey bottles), sometimes Fabric (water bottles)...

forge nor fabric are involved here, cauldrons are in 3 fill levels where the water bottles come from which is 1 bucket = 3 bottles and honey bottles is where you get the block = 4 bottles from

I know, after all I didn't say it depends on the mod loader, but a modloader matches/fits better.

I know, after all I didn't say it depends on the mod loader, but it matches/fits better with one of the mod loaders.

Honey bottles need to use 1/4 instead of 1/3 as vanilla defines 1 block as 4 bottles.

but why would 1 block be equal to 1 bucket? 1 bucker = 3 bottle and 1 block  = 4 bottles. doesnt all that add up?

The whole thing doesn't make sense. I have always meant for honey bottles to be 250 mb on Fabric too but it felt silly to add a constant just for that. Maybe it would have avoided this discussion at least. 😄
(I wrote FluidConstants.)

but why would 1 block be equal to 1 bucket? 1 bucket = 3 bottle and 1 block = 4 bottles. doesnt all that add up?

FluidConstants also defines a block as 81000.
Changing honey bottles to 1/3 will also require increasing the capacity of basins, which has a lot of implications, and is really not something I want to do.
I am going to keep them as 1/4. As long as mods use the transfer API properly, there shouldn't be any issues.

Tbh the only constant that seem made up is that one of that block right there. The other 2 are backed up by the cauldron recipe, the block however is not, should be 4 bottles for bottles themselves to be a consistent unit of measure

No, the variable BLOCK does not actually stand for honey blocks, but for iron/gold blocks. These consist of 9 INGOTs, which consist of 9 NUGGETs. A melted NUGGET is defined as 1000 droplets, an INGOT is 9 times as many and a BLOCK is 81 times as many.
Why else would Fabric have such weird units if not for this?
Both the problem of representing the amount of molten metals or the cauldron problem (which was not actually intended for honey!) were solved, as well as the specification of 1/4 buckets.

so where else does the convertion between 1 bucket = 4 bottles instead of 3 comes from?

Changing honey bottles to 1/3 will also require increasing the capacity of basins, which has a lot of implications, and is really not something I want to do.

I just watched a video about some Minecraft facts (https://youtube.com/watch?v=8rB2TQSPLuA) and there was one about honey and water bottles (at 8:36). Honey bottles are actually filled a little HIGHER than water bottles. This does not make the calculations any easier, but I think it is something to mention.


Is there a guide to embedding mruby in your application?

I am thinking about writing an interface to mruby from Crystal. I want to be able to run mruby apps from inside of Crystal, be able to access the result of running the script (return values or access to objects created inside of the script and I want to expose objects or methods from my application to the mruby script.
Is there a guide someplace that describes how to do this?
Thanks.

I haven't seen a full guide out there to walk someone through the process step by step. Most of the information can be found by referencing how other gems interact with the mruby API as well as using the documentation included with mruby to figure out the more specific details.
If you end up going through this task it would be nice if some informal documentation could be created as you go as there certainly are gaps with the currently organized information.

I thought that a collaborative book, e.g. on wikibooks would be great.

@beoran Or you may send pull-requests to the guides documentations.


[HIVEMALL-31][SPARK] Support Spark-v2.1.0

What changes were proposed in this pull request?
Support the latest Spark release.
What type of PR is it?
Improvement
What is the Jira issue?
https://issues.apache.org/jira/browse/HIVEMALL-31
How was this patch tested?
Run the existing tests.

@maropu test is failing for v2.1.
Saving to outputFile=/home/travis/build/apache/incubator-hivemall/spark/spark-common/target/scalastyle-output.xml
Processed 3 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 667 ms
error file=/home/travis/build/apache/incubator-hivemall/spark/spark-2.1/src/test/scala/org/apache/spark/sql/QueryTest.scala message=Header does not match expected text line=2
error file=/home/travis/build/apache/incubator-hivemall/spark/spark-2.1/src/test/scala/org/apache/spark/sql/catalyst/plans/PlanTest.scala message=Header does not match expected text line=2
error file=/home/travis/build/apache/incubator-hivemall/spark/spark-2.1/src/test/scala/org/apache/spark/sql/hive/HivemallOpsSuite.scala message=import.ordering.wrongOrderInGroup.message line=22 column=0
error file=/home/travis/build/apache/incubator-hivemall/spark/spark-2.1/src/test/scala/org/apache/spark/sql/hive/HivemallOpsSuite.scala message=import.ordering.wrongOrderInGroup.message line=30 column=0
error file=/home/travis/build/apache/incubator-hivemall/spark/spark-2.1/src/test/scala/org/apache/spark/sql/hive/test/TestHiveSingleton.scala message=Header does not match expected text line=2
error file=/home/travis/build/apache/incubator-hivemall/spark/spark-2.1/src/test/scala/org/apache/spark/sql/test/SQLTestData.scala message=Header does not match expected text line=2
error file=/home/travis/build/apache/incubator-hivemall/spark/spark-2.1/src/test/scala/org/apache/spark/sql/test/SQLTestUtils.scala message=Header does not match expected text line=2
error file=/home/travis/build/apache/incubator-hivemall/spark/spark-2.1/src/test/scala/org/apache/spark/sql/test/VectorQueryTest.scala message=import.ordering.missingEmptyLine.message line=25 column=0
Saving to outputFile=/home/travis/build/apache/incubator-hivemall/spark/spark-2.1/target/scalastyle-output.xml
Processed 25 file(s)
Found 8 errors
Found 0 warnings
Found 0 infos
Finished in 2737 ms
[ERROR] Failed to execute goal org.scalastyle:scalastyle-maven-plugin:0.8.0:check (default-cli) on project hivemall-spark: Failed during scalastyle execution: You have 8 Scalastyle violation(s). -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <goals> -rf :hivemall-spark
The command "mvn -q scalastyle:check test -Pspark-2.1" exited with 1.

I'll look into this failure.

Coverage decreased (-0.01%) to 35.831% when pulling 417fdeaeb9e6a4a921145e1fef8132f3c321231d on maropu:HIVEMALL-31 into ed0d139bea229183b286d36bf29cd027eb889634 on apache:master.

@maropu LGTM. Please merge this PR and close the JIRA issue.

BTW, you can close https://github.com/apache/incubator-hivemall/pull/23 as well.
Close #35, #23: xxxx xxxx

Merged

Thanks!


Migrate Gulp build to Webpack for Story Tools

For more details and instructions, see this gist:
https://gist.github.com/darinacosta/99034aeb04b1e312bce0fef545a553e3

Very helpful upgrade article for Gulp 4.0 https://zzz.buzz/2016/11/19/gulp-4-0-upgrade-guide/


Add language, other data to the Push to Archive during cataloging

A user suggested:

Language tags at IA are not working: On https://archive.org/details/librivoxaudio, it says there are 16,244 results, but only 69 items in English, 2 in German, and 1 in French.  It is not possible to have a list of all LibriVox recordings [at Archive] in a given language.

This would require the language data to be sent when the project is uploaded to IA during cataloging. I doubt we could make it retroactive, but it may be nice to have new projects bring over the language data.
At the same time, it would be nice to bring over the total project duration also, if possible. This is populated in the project database sometime during the "upload to Archive" step. It would be nice to plug that info into the "Run Time" field at Archive as well.
Priority for both: 5 (low)

Relates to / (near) duplicate of #8

I have started looking into these issues and the archive.org metadata for the LibriVox collection -- runtime is populated automatically when things work well, as part of the audio file processing and format generation. 17,650 items in the collection have a runtime  Only 310 items don't, and I'm not yet sure why.

Are you speaking of the LibriVox catalog, where some run times are missing?
That happens usually by human error (the cataloging system populates that field when sending the files to Archive, but if the MC has a browser window open with the database entry and makes an edit there, the run time and some other info auto-populated upon Archive delivery are erased, since they weren't in the database entry in their browser window.
As far as I know, they don't get added to the Archive pages unless the MC does it manually.

@twinkietoes-on Thanks for the response. I was talking about the archive.org metadata and collection. I was going by the statement from https://archive.org/developers/metadata-schema/index.html#runtime
runtime:

usage notes: Uploader can set this field, but most often we have determined and set this value during the derive process.

Which seems plausible (but I don't know for sure if it's true), and the fact that most of the collection on archive.org has a runtime: https://archive.org/search?query=collection%3Alibrivoxaudio+AND+runtime%3A*  vs. the ~310 which don't: https://archive.org/search?query=collection%3Alibrivoxaudio+AND+NOT+runtime%3A*
I can also imagine any auto-generation on the archive.org side being over-ridden in some cases  side, if a blank runtime is explicitly passed or something, so maybe it's complicated.
My main goal was to improve the archive.org language metadata for the https://archive.org/details/librivoxaudio collection, but this issue suggests runtime is a problem too. Missing runtime seems a lot rarer than missing language though  --it looks like there is a mechanism to populate runtime, but language  was just missing?  I've tried to add it in #161


Efficient and regular sampling of IMU data

Original report by Brian Calder (Bitbucket: brian_r_calder, ).

Currently (2.3.0), the IMU is polled as the run-loop gets to it, and whatever data is available is recorded.  The newer versions of the firmware correctly set the IMU to generate data at a reasonable rate, looks for repeated data, and culls it out, making the data stream a little less voluminous, and closer to regularly sampled.  However, this is a lot of extra work that we don’t need to do.
A better solution would be to use the interrupt pin on the MPU6050 to tell the ESP32 when new data is available, and have it read and record.  Taking a timestamp on the ESP32 when the interrupt is generated would also be good.

Original comment by Brian Calder (Bitbucket: brian_r_calder, ).

Resolved in ac71983 (dev-lsm6ds3 branch)


Website: cookbook needs a button to switch between console, WinForms, WPF, etc.

people using WinForms or WPF often get confused by the new() part of cookbook recipes
There should be tabs for "Console", "WinForms", "WPF", etc. that change the first line of cookbook recipes to one of the following:
ScottPlot.Plot myPlot = new();
ScottPlot.Plot myPlot = formsPlot1.Plot;
ScottPlot.Plot myPlot = WpfPlot1.Plot;

noted, will do soon


blacklist augmented with over 100 new domains, mostly from .ee top domain and a few others

Hello, I forked the list created by franga2000 and added mostly various .ee (Estonian) domains which redirect to Aliexpress. There are also a few domains with other top-level domains than .ee added. So far I have added over 100 domains in total. You might want to refer to this blacklist in your list of lists.
It is here: https://github.com/levitation-opensource/aliexpress-fake-sites

good jobs

@levitation You might want to open a pull request to add your list to the "Copycat sites" section.


How to modify the number of game steps in each cycle？

Hi！
I can only force the environment to stop at the desired number of steps by stopping it outside the environment.
for example:
for b in range(num_timesteps):
            train_num +=1
            # a = env.action_space.sample()
            action,_ = agent.take_action(state)
            print(action)
            next_state, reward, done, truncated = env.step(action)
            # state, action, reward, done
            episode_return += reward
            data_save.add(state,action,reward,done)
            # state, action, reward, next_state, done
            replay_buffer.add(state, action, reward, next_state, done)
            state = next_state
            if replay_buffer.size() > minimal_size:
                b_s, b_a, b_r, b_ns, b_d = replay_buffer.sample(batch_size)
                transition_dict = {
                        'states': b_s,
                        'actions': b_a,
                        'next_states': b_ns,
                        'rewards': b_r,
                        'dones': b_d
                        }

                agent.update(transition_dict)

i used num_timesteps to control the number of steps
I want to modify the steps from the environment. What parameters should I modify?
I sincerely hope to receive help.
Thanks

Hi @luckypipitao. If I understand you want to control the number of steps per episode, or episode length. By default the episode length equals to the number of hours in the simulation run period multiplied by the number of time steps per hour.
You have several solutions:

shorten the run period in the .idf file (see RunPeriod block)
If you use Ray, check out https://github.com/IBM/rl-testbed-for-energyplus/blob/3e3fc48765bfeaa2ec92221906fefcc7ef955169/ray_energyplus/ppo/run_energyplus.py#L98-L105 With that you can control the length of episodes (horizon) without resetting the environment (soft_horizon)