How to update embadding score for Universal sentence encoder

Hi,
Currently I am using USE to find semantic similarity between differebt texts. Now I want to update the embedding scores without adding new vocabulary. I am working on medical documents which have some specific vocabulary and many keywords are used in a particular context. The documents are in pdf files and have no labels. I want to train USE on new documents to update the embedding score for keywords which in turn can help me improve the sementic similarity score. I tried to find any relevent document to explain this process but so far no success.
How can I solve this problem, any help please?
Thanks!

Hi,
If I understand correctly, you want to fine-tune the USE encoder with your own training data and labels. If so, I think you can do something like this:
module_handler = "https://tfhub.dev/google/universal-sentence-encoder/4"
use_layer = hub.KerasLayer(module_handler, trainable=True)
model = tf.keras.Sequential([
     tf.keras.layers.InputLayer(input_shape=(...)),
     use_layer,
     tf.keras.layers.Dense(1)
])

Then you compile the model with MSE Loss and train with your data. You can find a similar workflow in this tutorial except that it is for image retraining.

Oh I just saw that your data has no labels. Then maybe you need a complete USE model training and start with the checkpoint provided by TF Hub, or other techniques such as negative sampling. I am not sure :)

Thanks for reply.  Actually I have text files but I have no labels. I would like to update the sentence embedding score based on domain specific data. Do you have any idea how can I go further?

I see your point. I think unsupervised fine-tuning is similar to the pretraining process itself, and can be done by the embedding framework itself (e.g. USE, word2vec). So maybe you can have a look on the USE paper to see how they construct training examples and what losses they use. Then you can construct your dataset similarly with your own text.
Notice that you don't need to implement the USE model itself, because it is already a complete encoder. The only thing you need to add might be an output layer to compute the loss.

Thanks for your reply. Actually I am new in this field. Can you explain the last part of your reply please?
"Notice that you don't need to implement the USE model itself, because it is already a complete encoder. The only thing you need to add might be an output layer to compute the loss."

For instance, if you want to train a USE model, you need to implement the encoder model, which is a transformer here, and one or more output layers to compute losses (e.g. a binary cross-entropy loss). Then you train the complete model by constructing training data from text.
With the checkpoint provided by TF Hub (e.g. hub.KerasLayer(...)), you don't need to implement the encoder itself because this is what the magic TH Hub link provides. Then you can start with the checkpoint and add the corresponding output layer and fine-tune the model on your own domain-specific data following the way how they construct training data and compute the loss.
This is just the way that I think is viable to unsupervised fine-tune a text encoder.

Thanks a lot, you have been really helpful. A last question:  in hub.Keraslayer method I have to give my output shape same as the USE delivers for after embedding a sentence which is TensorShape([1, 512]), right? Like below:
model = "USE_model"
hub_layer = hub.KerasLayer(model, output_shape=[512], input_shape=[],
dtype=tf.string, trainable=True)

I think you don't need to provide the output_shape. If you use the hub.KerasLayer inside a tf.keras.Sequential, the output shape of each layer will be computed automatically. But you definitely can play around to see if it is the case.

Thanks a lot JIn. I will try and get back in case any problem occurs.

How we can fine-tune the embeddings for my text corpus, it is not clear to me. I dnt have labels as stated here, should be completely Unsupervised.

I feel most folks here misunderstood the purpose of preptrained embeddings. For any embeddings, e.g., USE, word2vec, BERT, etc, they all aim at providing good initial embeddings to be used in downstream tasks such as classification or translation, etc. That's where fine-tuning happens. Whether the fine-tuning is supervised or unsupervised depends on your downstream task.
I don't have a downstream task, can I still fine-tune the embeddings themselves? Yes you can, but this is not the main purpose of these pretrained embeddings. And the fine-tuning under this line is basically the same as training an embedding from scratch (which indeed is unsupervised), except that now you have a better checkpoint which is trained on a larger corpus. E.g. you need a complete USE or word2vec model and their training methodology.
Back to your question, I mentioned how one may possibly train a USE embedding here.

For instance, if you want to train a USE model, you need to implement the encoder model, which is a transformer here, and one or more output layers to compute losses (e.g. a binary cross-entropy loss). Then you train the complete model by constructing training data from text.
With the checkpoint provided by TF Hub (e.g. hub.KerasLayer(...)), you don't need to implement the encoder itself because this is what the magic TH Hub link provides. Then you can start with the checkpoint and add the corresponding output layer and fine-tune the model on your own domain-specific data following the way how they construct training data and compute the loss.
This is just the way that I think is viable to unsupervised fine-tune a text encoder.

Also, for me, the purpose of TF-Hub is not to provide a complete pipeline with which you can simply feed the data and get the fine-tuned model (though it is making efforts towards this direction via tools which you can find in the repo).
Instead, the main purpose is to provide pretrained reusable layers that can be used in your own models. For instance, you don't need to implement a ResNet by yourself but can simply add it to your model via a TF-Hub layer. That being said, you have to define other parts of your model AND the loss, either supervised or unsupervised, even for a simple binary classification task.

Thanks. Though the fine-tuning I think we are asking about here and in issue #597  is the fine-tuning of the language model itself. This is not an unorthodox concept. Flair for example provides that here. A couple of applications for example, it would be great for example to see how Universal Sentence Encoders family fine-tuned on different domains/cultures cluster certain sentences together, thus exposing the divergence in association rules btw cultures or domains. Another more common example in industry is utterances in Chat bots. Different chat bots for different usages require the model to be fine-tuned on the bot's domain. So when someone says "I want Apple" in tech business the chat bot would not give him oranges.
Thanks a lot for your support, and has been great using TF-hub!

@AmmarRashed I am not meant to say that fine-tuning language modelling is uncommon. What I said is that TF-Hub simply provides layer-wise components instead of complete pipelines. Then, either a supervised classification or unsupervised language modelling, a complete pipeline including loss and training method is needed.
Maybe it would be better to have a colab tutorial, similar to fine-tuning on sentence classification, to show how to fine-tune language models such as USE :).

That would greatly helpful. Thanks!

@SyedAgha @AmmarRashed Can you guys open a new issue requesting the example. It would be easier to track it that way. Thanks!

@gowthamkpr  Done :) Thanks.

Closing this issue as it has been address. @AmmarRashed Thanks for opening a new issue


[CI] Shorten the CI names, and make sure that the CI names distinguish between the test jobs and the benchmark jobs

Okay, the CI names are much more concise now, which I think makes them more readable.

Codecov Report

Merging #18 (54b5c21) into master (de14843) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master      #18   +/-   ##
=======================================
  Coverage   93.82%   93.82%
=======================================
  Files           1        1
  Lines          81       81
=======================================
  Hits           76       76
  Misses          5        5

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update de14843...54b5c21. Read the comment docs.

The failures on Julia 1.0 will be fixed by #17.


Console commands

I'm thinking about doing a PR for a couple of commands. For example neo4j:index:drop person email to execute $client->dropIndex('Person','email');. However there are two issues with this:

I'm not sure if the symfony2 way of doing commands is the prefered way. They do seem to be somewhat compatible with laravel too plus the library already seems depedent on symfony components
There is already a Command folder, which in symfony is reserved for console commands. It's not a problem to use another folder, but how should it be named?

Console ?
However, if you plan to use neo4j in the future, I would suggest to wait a bit for the GraphAware 4.0 release.

Was waiting for the GraphAware 4.0 release

No worries man, I'll need to move all issues anyway to the GraphAware repository. I'm almost finished with Bolt which defines the overall architecture drivers should have (in accordance with Neo4j Technology Compliance Kit - still private now) So I'll be able to attack the http driver refactoring and embed everything in the 4.0 Release of NeoClient.


add manual DAE integrator

We will add @ikorotkin's dae integrator here: https://github.com/ikorotkin/dae-cpp
requires intel MKL, can be installed with apt using instructions here: https://software.intel.com/en-us/articles/installing-intel-free-libs-and-python-apt-repo

Hi @ikorotkin, I've wrapped up dae-cpp using pybind11, and created an example of how to use the wrapper in the test file tests/unit/test_solvers/test_daecpp_solver.py, based on your robertson example
Have a look and see if you can get it to work. After that, the remaining thing to do is to write a new solver within the pybamm framework that uses the wrapper.
dae-cpp and pybind11 are included as submodules in pybamm, so you will need to run these commands to get the code (this is after you clone the pybamm repo)
git submodule init
git submodule update

If you have already installed pybamm, you will need to reinstall it using pip so that the dae-cpp gets compiled. ie. something like (in the root pybamm dir)
pip uninstall pybamm
pip install -e .

You will of course need all the dependencies that you would ordinarily need to compile dae-cpp
after that you should be able to run the test for the wrapper:
python tests/unit/test_solvers/test_daecpp_solver.py

I had a problem where MKL could not load the correct libraries, it would give this error at run-time:
Intel MKL FATAL ERROR: Cannot load libmkl_avx.so or libmkl_def.so.

I found that I could get rid of this by preloading the mkl libraries, using:
export LD_PRELOAD=/opt/intel/mkl/lib/intel64/libmkl_def.so:/opt/intel/mkl/lib/intel64/libmkl_avx2.so:/opt/intel/mkl/lib/intel64/libmkl_core.so:/opt/intel/mkl/lib/intel64/libmkl_intel_lp64.so:/opt/intel/mkl/lib/intel64/libmkl_intel_thread.so:/opt/intel/lib/intel64_lin/libiomp5.so

This is clearly not ideal, so if you can shed any light on this it would be great. It could be something to do with how I am compiling dae-cpp and the wrapper, you can see what is done in the CMakeLists.txt file in the root pybamm directory

Thank you @martinjrobins, that looks great! I'll start looking into this tomorrow.

I've wrapped the stop_condition for dae-cpp RHS class now. Once you have defined a stop condition function in python:
def stop(x, t):
   return some_function_of(x, t)

then you can set this in the rhs class using the set_stop_condtion method:
rhs = pydae.RHS(fun_rhs)
rhs.set_stop_condition(stop)

Not something we are planning on doing at the moment


Message sending interupted by Chat GPT asking which response is better

The plugin needs to be reset sometimes and ChatGPT sometimes makes it inaccessible when there are so many other functions going on, I first noticed that the longtext didnt work when the internet was accessed using other apps. I hope that helps.

Can you elaborate a bit more? When does it stop working, when the interrupt happens or when you tab out or when something else happens?

Hi Nicole
Thanks for your email.
It freezes and the browser won't work either. It is to do with an error
showing ....  eventually responded this time.
Error says that says the plugin is slowing down chatgpt.
Screenshot was not attached, said too big.
On another note:
Are you available to customise this for local use?
I need better prompts.
Intake info
Then compose a 1letter based on format.
2 report a based on format
3 report b based on format.
On Tue, 21 Nov 2023, 2:06 pm Nicole, @.***> wrote:

Can you elaborate a bit more? When does it stop working, when the
interrupt happens or when you tab out or when something else happens?
—
Reply to this email directly, view it on GitHub
https://github.com/NicoleFaye/Chat-Gpt-Long-Text-Input/issues/37#issuecomment-1820294945,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/BBWV62AUS7WG3YVTMBDV5RTYFRAEVAVCNFSM6AAAAAA63Q55FWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQMRQGI4TIOJUGU
.
You are receiving this because you commented.Message ID:
@.***>

This is not an email, i am replying to your question on github. What browser are you using?

I am using Firefox and Chrome.
I think you have found a solution but I could suggest other new ideas if I may.
The app is very useful in accessing data, now you could add a format entry, so once the text is processed, the text can be reformated as per the template. I currently do that by manually entering a template I need.

Can you describe what you mean in a little more detail? Specifically what you mean by template, can you give me specifics of your workflow to see if its something I can integrate?

The exact reason for when it stops I dont know. I am not a technician, I am
very new at all this, I am soryI cannot tll you more.
I am using Chrome and Firefox.I have the paid version of ChatGPT, I noted
that if other plugins were accessing the internet the app would freeze.
I already told you about the error: is has more difficulty processing
(browser is slowed down)
It used to work well, now I am using the last version, the last version
works better, but still freezes sometimes.
On Tue, Nov 21, 2023 at 2:06 PM Nicole @.***> wrote:

Can you elaborate a bit more? When does it stop working, when the
interrupt happens or when you tab out or when something else happens?
—
Reply to this email directly, view it on GitHub
https://github.com/NicoleFaye/Chat-Gpt-Long-Text-Input/issues/37#issuecomment-1820294945,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/BBWV62AUS7WG3YVTMBDV5RTYFRAEVAVCNFSM6AAAAAA63Q55FWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQMRQGI4TIOJUGU
.
You are receiving this because you commented.Message ID:
@.***>

Next time it happens take a screenshot if you can and upload it here. Also note which other plugins are accessing the internet and i will look into it more.

Ok, I will do that.
I deleted all other extensions and because i use  a blocker I thought this
could the case.
I think your plug in has a greater use, like a compiler of raw data to a
particular format.
say various data go in, then you add a format (e.g.  letter, report_1,
formatX )
Your plug in enters the information, and is organised into the selected
format. I am doing that manually with ChatGPT but it is labour intensive.
On Thu, Dec 14, 2023 at 2:23 PM Nicole @.***> wrote:

Next time it happens take a screenshot if you can and upload it here. Also
note which other plugins are accessing the internet and i will look into it
more.
—
Reply to this email directly, view it on GitHub
https://github.com/NicoleFaye/Chat-Gpt-Long-Text-Input/issues/37#issuecomment-1855213247,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/BBWV62D2UGTUFAXFMPM4KVTYJKLPFAVCNFSM6AAAAAA63Q55FWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQNJVGIYTGMRUG4
.
You are receiving this because you commented.Message ID:
@.***>


Implemented non-flat world generation (fixes #136)

Utilizes extreme purlin noise generator.

Looks good to me 👍🏼

amazing

I'll have another go at it tomorrow.


Reduce heap consumed to track variants during dependency resolution

Expected Behavior
Gradle should consume less heap to represent variants in dependency resolution inputs and outputs.
Current Behavior
There are various different representations of variants in the dependency resolution inputs and outputs, and many duplicate instances of these types are created and retained in heap. This can consume a very large amount of heap for builds with many large dependency graphs.
This affects IDE import/sync in particular, as this typically does a lot more dependency resolution than task execution.
Context (optional)
No response
Steps to Reproduce
n/a
Gradle version
n/a
Build scan URL (optional)
No response
Your Environment (optional)
No response

First round of changes implemented in https://github.com/gradle/gradle/pull/24789

More changes in https://github.com/gradle/gradle/pull/24828

More changes in https://github.com/gradle/gradle/pull/24984, https://github.com/gradle/gradle/pull/25024 and https://github.com/gradle/gradle/pull/25076

Split out #25157 for further improvements.


Buggy behaviour with posts of multiple images/videos

Say there are 6 images in a post, moving through and clicking the button on each image gets images 1, 2, 3, 3, 5, where clicking on the 4th gets you the 3rd again and clicking on the 6th gives you nothing, or maybe another unpredictable combination of images
I hope this made sense
using Firefox 97.0.1
thanks

I don't encounter this issue recently. Could you provide the post link?

in line 298
// multiple imgs or videos
let idx = 0;
// check current index

       if (!articleNode.querySelector('.coreSpriteLeftChevron')) {

       if (!articleNode.querySelector('button[aria-label="Go Back"]')) {
           idx = 0;

       } else if (!articleNode.querySelector('.coreSpriteRightChevron')) {

       } else if (!articleNode.querySelector('button[aria-label="Next"]')) {
           idx = list.length - 1;
       } else idx = 1;

       let node = list[idx];

I don't encounter this issue recently. Could you provide the post link?

Example: https://www.instagram.com/p/CdDkUbZsQQA/
Skips a few images and downloads another one twice.

I don't encounter this issue recently. Could you provide the post link?

Example: https://www.instagram.com/p/CdDkUbZsQQA/
Skips a few images and downloads another one twice.

Was having the same issue myself, specially on my Android phone. Try this test fork, and see if it fixes your issue as well. Then y252328 can modify the code.

I don't encounter this issue recently. Could you provide the post link?

Example: instagram.com/p/CdDkUbZsQQA
Skips a few images and downloads another one twice.

Was having the same issue myself, specially on my Android phone. Try this test fork, and see if it fixes your issue as well. Then y252328 can modify the code.

Got 10 different images with your fork, no duplicates, whoo! The file name format appears to be slightly different, but that's no issue for me at least.

The file name format appears to be slightly different

const postFilenameTemplate = '%postId%-%mediaIndex%-%id%';

That is some change I made along with other, as I like it this way, kind of how I'm used to it actually.
y252328 should feel free to modify the original code, using my fork, as they see fit.

Hi FlowerForWar,
Thanks for your great fork!
I have merged your code into master branch (commit 192c6a) and applied some modifications (please refer to commit message).
Please take a look and feel free to reply to this issue or file a new issue if you have any concern, thanks.

No problem. Thank you for this great user script as well.
I'm new to Github and how things work here, if I have an issue I'll let you know.


Could you please give me some instructions about which parts of the Cartographer should I modify to adapt it to the xv-11 lidar?

Could you please give me some instructions about which parts of the Cartographer should I modify to adapt it to the xv-11 lidar?
Basically, I want to test the performance of Cartographer ros when it is connected to xv-11 lidar.

You should close this issue (as it's not a defect) and ask the same question in the news group.
You have nothing but laser data? If so, use the realtime scan matcher. You will need to set the min/max_range parameters in the lua file. I don't think that you need to configure most other values.


Possible bug in stream_dbfile

Hi @gi0baro,
I do not know where the problem may be. I will try to put the maximum information about what is happening.
Given a model with an upload field, an image in my case.
In development mode works fine. I upload the image and I can show it on some page, but in production (nginx + gunicorn) the following happens:

The image is uploaded well to the server
The image fails to display on the page

I did this test:
Create a tunnel to the server to access port 8000 and start the development server from weppy.
[develop]

I uploaded the image and I could see it without problems

[nginx]
2) Try to view image uploaded in (1) and fail.
3) I uploaded another image but could not see it
[develop]
4) I can see the image uploaded in (3)
The download function is this:
@app.route("/download/<str:filename>")
def download(filename):
    stream_dbfile(db, filename)

If I copy the url of the image and paste it in another tab, sometimes it gives:
"Internal Server Error" and other times malformed image
There is no error in the nginx log.
If you need any further proof, please let me know.
Jose

@josejachuf in production you should have exceptions logged into logs/production.log inside your application package. Can you check it out and see if you have anything useful there?

@gi0baro
Nothing, just this message:
[2017-03-15 15:47:47,604] WARNING in ext: No mailer seems to be configured. The auth features requiring mailer won't work.

I bring something else.
Configuring the same environment (nginx + gunicorn) locally, (with w0.85 and w1.0) but with python27 another application that I have works well. I'm going to test with python3 that the one I have on the server.
The problem is likely to come from elsewhere.

I do not know if I have any problems in the configuration, but it gives me problems with gunicorn with python3, with python2 everything works fine. I'll look for that side

The problem is definitely in gunicorn with python3. I switched to uwsgi and it works fine.
I'll see that it can be changed

@gi0baro
Viewing the gunicorn log, this [1] is the same problem that occurs with python3 and gunicorn.
In the end the author writes: closing an issue as this bug happen outside of gunicorn.
Jose
[1] https://github.com/benoitc/gunicorn/issues/1214

@josejachuf I'm reopening this 'till I verify what happens with gunicorn and python3.

@gi0baro
with python36 and gunicorn, downloading in this way, works fine
```

buffer_stream = io.BytesIO()
template_doc.save(buffer_stream)
response.headers['Content-Type']='application/docx'
response.headers['Content-Disposition'] = 'attachment; filename=o_%d.docx'%obj.numero
return buffer_stream.getvalue()

Jose

Also gives problems with these files: weppy

[2017-03-29 13:28:09 -0300] [12852] [ERROR] Error handling request /weppy/jquery.min.js
Traceback (most recent call last):
File "/usr/home/www/venv36/lib/python3.6/site-packages/gunicorn/workers/sync.py", line 135, in handle
self.handle_request(listener, req, client, addr)
File "/usr/home/www/venv36/lib/python3.6/site-packages/gunicorn/workers/sync.py", line 179, in handle_request
resp.write_file(respiter)
File "/usr/home/www/venv36/lib/python3.6/site-packages/gunicorn/http/wsgi.py", line 411, in write_file
if not self.sendfile(respiter):
File "/usr/home/www/venv36/lib/python3.6/site-packages/gunicorn/http/wsgi.py", line 390, in sendfile
self.send_headers()
File "/usr/home/www/venv36/lib/python3.6/site-packages/gunicorn/http/wsgi.py", line 337, in send_headers
util.write(self.sock, util.to_bytestring(header_str, "ascii"))
File "/usr/home/www/venv36/lib/python3.6/site-packages/gunicorn/util.py", line 509, in to_bytestring
return value.encode(encoding)
UnicodeEncodeError: 'ascii' codec can't encode character '\xe9' in position 153: ordinal not in range(128)

@josejachuf I tried to reproduce this today but on python 3.5.2 and gunicorn 19.7.1 the url /__weppy__/jquery.min.js is served correctly.
Run with gunicorn -w 4 bloggy:app on bloggy example.
Will try also on stream_dbfile but the streamer seems ok.

@josejachuf I've tested with stream_dbfile too and I can't reproduce the error. I'm closing this.

Hi @gi0baro
I just tried, setting up the same environment and everything works fine. Or changed weppy (or dependencies), or changed gunicorn (or dependencies) or changed nginx.
I tried getting down to weppy 1.0.2 and it still works fine. Also go down to gunicorn 19.7.0 which is the one used when I published this problem
I do not know what it might have been, maybe some layer of dependencies below.
Jose

@gi0baro , the same problem continues to occur.
This is the output of gunicorn:

[2017-09-23 18:48:37 -0300] [69927] [ERROR] Error handling request /weppy/helpers.js
Traceback (most recent call last):
File "/usr/home/www/venv/lib/python3.6/site-packages/gunicorn/workers/sync.py", line 135, in handle
self.handle_request(listener, req, client, addr)
File "/usr/home/www/venv/lib/python3.6/site-packages/gunicorn/workers/sync.py", line 179, in handle_request
resp.write_file(respiter)
File "/usr/home/www/venv/lib/python3.6/site-packages/gunicorn/http/wsgi.py", line 411, in write_file
if not self.sendfile(respiter):
File "/usr/home/www/venv/lib/python3.6/site-packages/gunicorn/http/wsgi.py", line 390, in sendfile
self.send_headers()
File "/usr/home/www/venv/lib/python3.6/site-packages/gunicorn/http/wsgi.py", line 337, in send_headers
util.write(self.sock, util.to_bytestring(header_str, "ascii"))
File "/usr/home/www/venv/lib/python3.6/site-packages/gunicorn/util.py", line 509, in to_bytestring
return value.encode(encoding)
UnicodeEncodeError: 'ascii' codec can't encode character '\xe1' in position 152: ordinal not in range(128)

when is called:

my_domain/weppy/helpers.js (weppy between double underscore)

@gi0baro I already found because the error and the solution to this. It is related to this [1]. To solve the problem in the templates I use the following in the ini.py of the application:
import locale
locale.setlocale(locale.LC_ALL,'es_ES.UTF-8')

The previous lines correct the templates, but apparently with gunicorn gives me the mentioned problem.
Removing these lines solves everything and is more, in production is not given the error [1] in the templates. It should be related to the behavior you mentioned to me in [2], about how the behavior of the templates in development and in production differs.
Jose
[1] https://groups.google.com/forum/#!topic/weppy-talk/GjVGJ3O3p80
[2] https://groups.google.com/forum/#!topic/weppy-talk/jXbEmEdmcwc

@josejachuf this sounds really strange to me. The templating system shouldn't change the way it handles unicode/utf-8 from when it has reloader or not.
Are you using Python 3? The templating system will use unicode both on Python 2 and 3 versions. I've never faced these errors with italian language. The fact is: if you handle non-utf8 characters you should use python in templates, since the system should handle the rest.

@gi0baro Yes, I am using python3. This has happened since I started with weppy, version 0.6 or 0.7 through 1.1.1.
This is my locale:

% locale
LANG=es_AR.ISO8859-1
LC_CTYPE="es_AR.ISO8859-1"
LC_COLLATE="es_AR.ISO8859-1"
LC_TIME="es_AR.ISO8859-1"
LC_NUMERIC="es_AR.ISO8859-1"
LC_MONETARY="es_AR.ISO8859-1"
LC_MESSAGES="es_AR.ISO8859-1"
LC_ALL=

Jose

Changing LANG works fine:
% setenv LANG es_AR.UTF-8
You can show the output of your locale
Jose

@josejachuf here is my locale:
(weppytestpy3) ➜  bloggy git:(master) ✗ locale
LANG=
LC_COLLATE="C"
LC_CTYPE="UTF-8"
LC_MESSAGES="C"
LC_MONETARY="C"
LC_NUMERIC="C"
LC_TIME="C"
LC_ALL=


Add Mongolia's Crylic (mn) Language Support

Description
Thanks to Google's Gemini Advanced, we can translate existing English to any other languages. Let's support this.
Expected Behavior
Language is available
Current Behavior
Language is not available.
Associated Data Files
No response

base layer established (ref: cbe47f51b40c8b1206953f9b313c671635667a16).

push out and prioritize features & bug fixing instead.


Bridge request for Oglaf

Bridge request

General information

Host URI for the bridge (i.e. https://github.com): https://www.oglaf.com

Which information would you like to see?

Instead of having a simple paragraph indicating the number of panels, I would like to have all images directly in the RSS feed

How should the information be displayed/formatted?

Ideally, images would be displayed directly as block html elements, one by one

Which of the following parameters do you expect?

[X] Title
[X] URI (link to the original article)
[X] Author
[X] Timestamp
[X] Content (the content of the article)
[X] Enclosures (pictures, videos, etc...)
[ ] Categories (categories, tags, etc...)

Options

[ ] Limit number of returned items

Default limit: 5

[X] Load full articles

Cache articles (articles are stored in a local cache on first request): yes
Cache timeout (max = 24 hours): 24 hours

[X] Balance requests (RSS-Bridge uses cached versions to reduce bandwith usage)

Timeout (default = 5 minutes, max = 24 hours): 5 minutes

I created the issue for tracking but, truth being told, I'm starting implementing it right now

https://www.oglaf.com/feeds/rss

Was going to say... they already have a feed.

They do, but the image is not included in the feed itself, so you have to click the link for each article


Corruption when fullscreening application while using hardware cursors

wlroots/sway versions
wlroots version: 0.10.0.r178.ga3ba8288-1
sway version: sway version 1.4-d7900c6e (Jun  6 2020, branch 'master')
Kernel: 5.6.15-arch1-1
mesa: 20.0.7-3
GPU/Drivers: Navi, amdgpu
Description
When using hardware cursors and fullscreening kitty, I get graphical corruption rendering the terminal unsuable. That does not mean the terminal does not work, I just cannot see what I am typing on it. When exiting fullscreen everything works as expected. I have only been able to reproduce this with kitty, so it is entirely possible this is a kitty or glfw bug, however this bug manifests itself by changing the WLR_NO_HARDWARE_CURSORS environment variable.
Reproduction
Start sway with WLR_NO_HARDWARE_CURSORS=0 sway -c test_config, and then launch kitty.
test_config is two lines:
include /etc/sway/config
bindsym $mod+m exec kitty

When setting WLR_NO_HARDWARE_CURSORS=1 this issue does not occur.
Logs
Log files created with
WLR_NO_HARDWARE_CURORS=(1|0) WAYLAND_DEBUG=1 sway -c test_config -d 2>sway.log

With WLR_NO_HARDWARE_CURSORS=1: https://0x0.st/iVPG.log
With WLR_NO_HARDWARE_CURSORS=0: https://0x0.st/iVPD.log
Please let me know whatever information is relevant. I did not attempt to bisect this because I have never known a version where this works. I rarely put terminals in fullscreen.

Sounds related to direct scan-out. Maybe related to https://github.com/swaywm/sway/issues/5428

Cannot reproduce this anymore.


[Question] Is it safe to update the firmware on our NUKI? (and will it stay safe?)

Hi!
Not really an issue, but more a question.
I saw that my Nuki had a firmware update available.
While it might be safe now to update, do you think it will stay safe?
I was wondering if they might able to block access to this hub in the future.
BTW: Love the NUKI-Hub. I even created a custom case for it.

Nuki is actually supporting projects like this. The API for the bluetooth communication is available directly from Nuki, and there's a developer forum to ask questions.
Nuki Hub uses the same protocol that the smartphone app and the Nuki Bridge use. If they want to lock out third party implementations, they'd have to change the protocol and force users to update all devices connected to the lock ... a difficult thing to do.
I'd say don't worry too much, as this is endorsed by Nuki.

Ok. Great to hear!


Is there an AOT implementation?

First of all, fantastic project. Does it run AOT compiled, something like on CoreRT run-time?
I know CoreRT is far from finished, but you get the point. May be using LLVM infrastructure to some C++ minimal run-time, similar to what .NET Native does (UWP)... ?

@nawfalhasan, I'm glad you asked this. This is one of the secret goals that I've been itching to add to the docs since day one, but it isn't there simply because of the fact that I never tested it :)
This is one of the key driving factors for me to invest time in this. But as you said, CoreRT is far from finished. I wanted to ensure that the day you could use CoreRT, WinApi should go along right away. Infact, that's also one of the reasons I decided to split out several mundane abstractions, like Rect, Point, Size, Color, and so on, into NetCoreEx (https://github.com/prasannavl/NetCoreEx) - It's in a very early stage though. So that WinApi doesn't end up blocking on some huge library that doesn't compile into native for whatever reason.
Currently, there are no other external dependencies except the NetCoreEx which is also developed on .NET Core.
That being said, is it usable today?
The simple answer is I don't know. I haven't tested it. But, of the top of my head, there isn't any complex scenario that would make it difficult to work with CoreRT. I wanted to ensure that all the functional components are in place, before testing out the native compilation.
I'd say it's a little early to be making any kind of CoreRT compatibility call. But if you have an application that does run on CoreRT and WinApi is somehow the blocking factor, I'd do my best to look at it as soon as possible - because it is a key goal - just haven't gotten there yet.


lsd2dsl: 0.5.2 → 0.5.4

Motivation for this change
Changelog
Things done

[ ] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[x] NixOS
[x] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[x] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[x] Fits CONTRIBUTING.md.

Result of nixpkgs-review pr 134364 at c1f7d027 run on x86_64-linux 1

1 package built successfully:

lsd2dsl

1 suggestion:

warning: missing-phase-hooks
installPhase should probably contain runHook preInstall and runHook postInstall.
Near pkgs/applications/misc/lsd2dsl/default.nix:30:3:
   |
30 |   installPhase = ''
   |   ^


REQ: Add support for fuse-t on macOS

There's a FUSE replacement for macOS that doesn't need a kext anymore: macos-fuse-t/fuse-t. It's supposed to be a drop-in replacement for osxfuse/macfuse, but just adding find_library('fuse-t') to the list in fuse.py now produces this error when trying to mount my Switch's eMMC:
$ sudo mount_nandhac -d --keys keys/prod_mbirth.keys /dev/disk8 ./fuse
ninfs v1.6.1 - https://github.com/ihaveamac/ninfs
- Note: This should *not* be run as root.
- The mount will not be normally accessible by other users.
- This should be run from a non-root terminal.
- If you want root to be able to access the mount,
-   you can add `-o allow_root` to the arguments.
FUSE library version: 2.9.9
nullpath_ok: 0
nopath: 0
utime_omit_ok: 0
unique: 2, opcode: INIT (26), nodeid: 0, insize: 56, pid: 0
INIT: 7.18
flags=0xfe00007b
max_readahead=0x00000000
   INIT: 7.19
   flags=0x00000011
   max_readahead=0x00000000
   max_write=0x02000000
   max_background=0
   congestion_threshold=0
   unique: 2, success, outsize: 40
unique: 3, opcode: STATFS (17), nodeid: 1, insize: 40, pid: 0
statfs /
   unique: 3, success, outsize: 96
unique: 4, opcode: GETATTR (3), nodeid: 1, insize: 56, pid: 0
getattr /
   unique: 4, success, outsize: 136
unique: 5, opcode: LOOKUP (1), nodeid: 1, insize: 47, pid: 0
LOOKUP /disk8)
getattr /disk8)
   unique: 5, error: -2 (No such file or directory), outsize: 16
short read on fuse device

So this might need a few more tweaks, I guess.

The core of this issue may be due to how fuse-t handles parsing options and it not liking a slash. Notice at the end that it's trying to open "/disk8" in the filesystem. This path would have been displayed in the volume name in the form of "Nintendo Switch NAND (dev/disk8)".
I tested this with the 3dsx mount and found that a volname of "3DSX Homebrew (Downloads/FBI.3dsx)" crashes, but "3DSX Homebrew" alone doesn't. Or any other name without a slash.
So what I'll probably do instead is only display the filename and not its containing folder.

By the way you can also set FUSE_LIBRARY_PATH=/usr/local/lib/libfuse-t.dylib to force fusepy to load fuse-t without any source code edits.

0b33c846f6bc8534ec2759fb58ec40ca677fb3df will try to load fuse-t if it can't find macFUSE.


unexpected keyword argument 'renderer' DJANGO 2.1

in django 2.1 an error happens
`

Request Method:
GET

http://localhost:8000/admin/videos/youtube/add/

2.1

TypeError

render() got an unexpected keyword argument 'renderer'

`

This is addressed in PR #88.
For now you can use the workaround mentioned there.


Integrate Seam Connect Fake + Basic Hooks

feat: Use seam-connect-fake for local storybook
test: Use seam-connect-fake in test

@seveibar I went down the concurrently route and it has issues. This PR is the one we want, just need to resolve the merge conflicts https://github.com/seamapi/react/pull/46


Add withClearQueued methods to clear queued SnackBars

Allow to clear queued messages prior to displaying a new one. You don't need to store SnackBar field to dismiss queued messages with these additional methods.

@MrEngineer13 any chance to get it integrated?

Thanks tomrozb for being so patient. Finally got some time to integrate this


object 'is_abs_path' not found

Hello,
when I run Rscript -e "bookdown::render_book('index.Rmd', 'bookdown::gitbook')", I get the following error message:
output file: bookdown-demo.knit.md

/usr/bin/pandoc +RTS -K512m -RTS bookdown-demo.utf8.md --to html4 --from markdown+autolink_bare_uris+tex_math_single_backslash --output bookdown-demo.html --lua-filter /usr/lib/R/site-library/bookdown/rmarkdown/lua/custom-environment.lua --lua-filter /usr/lib/R/site-library/rmarkdown/rmarkdown/lua/pagebreak.lua --lua-filter /usr/lib/R/site-library/rmarkdown/rmarkdown/lua/latex-div.lua --metadata-file /tmp/RtmpeK0v3x/filedc634e3f7795 --wrap preserve --standalone --section-divs --table-of-contents --toc-depth 3 --template /usr/lib/R/site-library/bookdown/templates/gitbook.html --highlight-style pygments --number-sections --css style.css --include-in-header /tmp/RtmpeK0v3x/rmarkdown-strdc63614fa11d.html --mathjax --filter /usr/bin/pandoc-citeproc
Error in move_files_html(output, lib_dir) :
  object 'is_abs_path' not found
Calls: <Anonymous> ... render_cur_session -> <Anonymous> -> <Anonymous> -> move_files_html
Execution halted

I tried to google a bit on this error message, but failed to find any hint.
My system is a Debian testing and I installed the relevant packages from the Debian repositories. I can give you more details if needed, but so far I'm not even sure of what information could help you. Sorry about that.

Which versions of packages are you using ?
If you update to last CRAN version of knitr and bookdown, it should be ok. This was an issue between package updates last year but shouldn't be an issue anymore.
You should be using a recent knitr with an older bookdown problably. 🤔

Yes, that's the reason: your bookdown is way too old (from 2020), but knitr is relatively new. Personally I don't really recommend installing R packages from Debian repositories because you don't have control over when they can be updated. Especially for packages that do not require compilation, I'd just use install.packages() in R to install them. That way, you can easily update them via update.packages() at any time.

For the record, I reported this bug against Debian here: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=991566

Thank you!


how to change header logo for every tab?

hi i am new to android and trying to create an application like google news let  and i completed app with the help of your library and now i am trying to change header logo for every tab with animation or without animation  like play newsstand can you help me for this .

you can do it from the setMaterialViewPagerListener
ImageView headerLogo = (ImageView)findViewById(R.id.myLogo);

mViewPager.setMaterialViewPagerListener(new MaterialViewPager.Listener() {
            @Override
            public HeaderDesign getHeaderDesign(int page) {
                switch (page) {
                    case 0:
                    	headerLogo.setDrawable(myDrawable1);
                        return HeaderDesign.fromColorResAndUrl(
                                R.color.green,
                                "https://fs01.androidpit.info/a/63/0e/android-l-wallpapers-630ea6-h900.jpg");
                    case 1:
                    	headerLogo.setDrawable(myDrawable2);
                        return HeaderDesign.fromColorResAndUrl(
                                R.color.blue,
                                "http://cdn1.tnwcdn.com/wp-content/blogs.dir/1/files/2014/06/wallpaper_51.jpg");
                    case 2:
                    	headerLogo.setDrawable(myDrawable3);
                        return HeaderDesign.fromColorResAndUrl(
                                R.color.cyan,
                                "http://www.droid-life.com/wp-content/uploads/2014/10/lollipop-wallpapers10.jpg");
                    case 3:
                    	headerLogo.setDrawable(myDrawable4);
                        return HeaderDesign.fromColorResAndUrl(
                                R.color.red,
                                "http://www.tothemobile.com/wp-content/uploads/2014/07/original.jpg");
                }

                //execute others actions if needed (ex : modify your header logo)

                return null;
            }
        });

look at the headerLogo.setDrawable(myDrawable1);

well while i change the viewpager,and the header logo change,too . and if i want to add a scale animation like google newsstand.could you please tell me how to do it?

How to  left side arrow  remove in toolbar??
& how to custom toolbar in main matrialview viewpager


Support const entries in P4TC

Ticket - https://github.com/p4tc-dev/p4tc-e2e/issues/30
As an example, in the following program:
table calculate {
        key = {
            hdr.p4calc.op        : exact @name("op");
        }
        actions = {
            operation_add;
            operation_sub;
            operation_and;
            operation_or;
            operation_xor;
            operation_drop;
        }
        const default_action = operation_drop();
        const entries = {
            P4CALC_PLUS : operation_add();
            P4CALC_MINUS: operation_sub();
            P4CALC_AND  : operation_and();
            P4CALC_OR   : operation_or();
            P4CALC_CARET: operation_xor();
        }
    }

The compiler should generate the template code for these constant table enties.
For the above example, it should be the following:
$TC p4template update table/calc/MainControlImpl/calculate entry op 0x2b action calc/MainControlImpl/operation_add
$TC p4template update table/calc/MainControlImpl/calculate entry op 0x2d action calc/MainControlImpl/operation_sub
$TC p4template update table/calc/MainControlImpl/calculate entry op 0x26 action calc/MainControlImpl/operation_and
$TC p4template update table/calc/MainControlImpl/calculate entry op 0x7c action calc/MainControlImpl/operation_or
$TC p4template update table/calc/MainControlImpl/calculate entry op 0x5e action calc/MainControlImpl/operation_xor

Merged to main


Make constant file pub

Motivation

Closes #

Changes

Test Plan

TODO

[ ] Explain motivation or link existing issue(s)
[ ] Test changes and document test plan
[ ] Update documentation as needed

DevOps Notes

[x] This PR does not require configuration changes (e.g., environment variables, GitHub secrets, VM resources)
[x] This PR does not affect public APIs
[x] This PR does not rely on a new version of external services
[x] This PR does not make changes to log messages (which monitoring infrastructure may rely on)

By submitting this pull request, I confirm that my contribution is made under the terms of the MIT license.

Those constants are used internally for appending the reveal script to the script builder. Any particular reason why they should be exported?


Ignoring verbatim environments in latex

I get false positives in latex files in verbatim environments. How can I tell the plugin to ignore these environments?

You don't.  The existing linters for TeX / LaTeX are less than great. shrug

I switched my checker to chktex and altered my .chktexrc to ignore the custom verbatim environments I needed.


Specify apiVersion in datasources provisioning file

The datasource provisioning isn’t working properly for me with Grafana 5.2.x. It won’t import the following fields:

basicAuth
basicAuthUser
basicAuthPassword:
isDefault

Also, I saw the following log message in the Grafana log during restart:
t=2018-08-05T21:14:08+0200 lvl=warn msg="[Deprecated] the datasource provisioning config is outdated. please upgrade" logger=provisioning.datasources filename=/etc/grafana/provisioning/datasources/ansible.yml

By reading https://github.com/grafana/grafana/blob/6f1b125c489a3ed9282ec004cb56ba35d892356d/pkg/services/provisioning/datasources/config_reader.go#L80, I found out that the lack of the apiVersion field in the provisioning file caused the config parser to treat it as an old config file, presumably with fewer support fields.
I fixed it by adjusting the task to write a provisioning file according to http://docs.grafana.org/administration/provisioning/#example-datasource-config-file.

This will break compatibility with older versions. Could you use jinja and grafana_version to allow older schema for older grafana versions? Unless this is not needed for grafana 5.0.x and/or 5.1.x.

The docs for 5.0 and 5.1 also have the apiVersion version field set to 1. So I think this shouldn’t break compatibility. And as far as I can see, anything below Grafana 5.0 doesn’t support provisioning anyway.
I just saw that the Travis CI build failed for centos7 and fedora though. I’ll see if I can figure out why.

Oh, just saw the my fix is exactly the same what @XooR did in #76. Closing this one.


[GCI] Hide deleted comments

Fixes #508
Describe the changes you have made in this pr -
Deleted comments are hidden.
However, I still need some help with the flash messages part.
ping @shubhankarsharma00
GCI task

Coverage remained the same at 82.507% when pulling e569a0b3b56e9f9d48a39e45298a08e896b185ad on junron:508comment_disappear into 6569232a75d650e5123363c7f51280129df87f9b on CircuitVerse:master.

What I meant with a flash message was actually a js function to show an undo option for 10 seconds or so. I think this can be done using a setTimeout function (which can trigger events after a set time) over here:
https://github.com/CircuitVerse/CircuitVerse/blob/535b3c269b003aaa523492563af7be156a053b4d/app/views/commontator/comments/_actions.html.erb#L22-L28
But I think the PR satisfies the issue at hand and the issue of whether there should be a flash message or a confirm before deleting can be dealt with later in a new issue. This seems good enough.

Thanks for the swift response! I'll submit my task.


Update Black checking process and fix output in PR

List of Changes

Make Black check only modified file
Fix errors in a PR comments.

Motivation

Tests are failing and should be passed.

Testing Status
Tested in my fork https://github.com/naveen521kk/manim/pull/23 and https://github.com/naveen521kk/manim/pull/24
Acknowledgement

[x] I have read the Contributing Guidelines

:tada: :rocket: :tada: :rocket: :tada: :rocket: :tada: :rocket: :tada: :rocket: :tada: :rocket:

Also, it's not a huge deal, but CodeFactor is asking you to add newlines at the end of some files....


Feature/next migrate

PR for next.js migration from create-react-app. Work in progress.

@sunguru98 is it good to look at, or is it still failing? looks like vercel isn't happy

Closing to reopen as native branch ..


Stackanetes uses kpm & Ingress.

ChangeLog (big lines)

Based of 3c00aa8858652e
Discard the old python deployer and replace it by kpm

Provide many advantages in term of lifecycle management (updates) and flexibility (conditional deployments)
Ease code maintenance, modularity and reusability with a simple architecture made of pretty independent packages and human-readable Kubernetes manifests
Add ability to easility deploy sharded applications
Reduce the list of dependencies for deployment to one
Allow reproducible deployments with versioning, support for release channels and sharable configuration

Add support for external load-balancer to access OpenStack APIs (formerly https://github.com/stackanetes/stackanetes/pull/73)
Remove rados-gateway as it should be deployed as part of Ceph instead (as discussed) and make Glance use rbd instead, therefore adding Copy-on-Write support
Remove fluentd/kibana/elastisearch as it should be deployed as part as Kubernetes instead (as discussed)
Make searchlight use a standard elastic search image as the one provided by Kubernetes has too several hardcoded values and poor cluster bootstrapping behavior (as discussed)
Remove usage of the Ceph's admin keyring and use specific users instead
Offer ability to configure multiple DNS servers, which may be useful to resolve Kubernetes nodes' hostnames to enable live-migrations
Rewrite README entirely with clear requirements, setup instructions and expectations
Provide OpenStack bash files for testing/demo purposes
Simplify and cleanup where clearly feasible,
Adopt some standards around manifest definition

Can we have a way to somehow template passwords ? For now it is just hard-coded.

@PiotrProkop Values (incl. passwords) in stackanetes/parameters.yaml aren't hardcoded per se. They are the ones that are shipped by default within the Stackanetes package to the kpm registry and thus, they serve as defaults. Any values can be overridden at deploy time using a YAML file containing custom values, using kpm deploy stackanetes/stackanetes --namespace openstack --variables custom.yaml -H https://beta.kpm.sh (as in the README).
# custom.yaml
keystone:
  admin_password: foo

Does that make sense?

LGTM


Server crash when placing a block on my modpack server

Describe the Bug
ticking block crash
Reproduction Steps
no idea
Expected Result
to not crash
Screenshots and Videos
No response
Crash Report or Log
https://mclo.gs/GFZJ0J4
Operating System
windows 10
Mod Version
0.4.1
Minecraft Version
1.18.2
Other Mods
https://www.curseforge.com/minecraft/modpacks/haywen-unity-fe/files/3806881
Additional Context
No response

Threw it into Crashy, seems to have been caused by a piston? Hope this helps anyone trying to troubleshoot! https://crashy.net/PKFXTWXg6jE38fjosCsx

This doesn't seem to be related to Create at all, please test without it.

Apologies, it's just a weird issue.


feat(extension-system): transport now extensible

Update:
The major problem right now is TypeScript performance. I need to optimize things.
Inference is probably the number 1 culprit.
I could improve things here:

Define the request pipeline with static types
Define the extensions with static types

It is ugly but contained and clear. I just need to figure out the API for supplying the pre-built types.
Other ideas:

Is the ConfigManager utility leading to performance issues?
Can we make use of more interfaces and less type aliases?
Look for ways to simplify the extension type system


Humidifier entity lost after update

Govee Device SKU
H7142
Govee2MQTT Version
2024.01.17-e8eb8dd7
Describe the issue
Auto-parameter seems to no longer report after update. This parameter with 0 dedicated the water tank was empty, and 1 when full. The entity name populated as number.humidifier_livingroom_auto_parameter.
Startup Diagnostics
GOVEE_MQTT_PASSWORD=REDACTED
GOVEE_MQTT_USER=addons
GOVEE_MQTT_PORT=1883
++ cd /app
++ exec /app/govee serve
[2024-01-17T18:44:50 INFO  govee::commands::serve] Starting service. version 2024.01.17-e8eb8dd7
[2024-01-17T18:44:50 INFO  govee::commands::serve] Querying platform API for device list
[2024-01-17T18:44:51 INFO  govee::commands::serve] Querying undocumented API for device + room list
[2024-01-17T18:44:53 INFO  govee::service::iot] Connected to IoT: CONNACK code 0: Connection Accepted.
[2024-01-17T18:44:53 INFO  govee::commands::serve] Starting LAN discovery
[2024-01-17T18:44:53 INFO  govee::commands::serve] Waiting 10 seconds for LAN API discovery
[2024-01-17T18:44:53 INFO  govee::service::iot] IoT (re)connected with status CONNACK code 0: Connection Accepted.
[2024-01-17T18:45:03 INFO  govee::commands::serve] Devices returned from Govee's APIs
[2024-01-17T18:45:03 INFO  govee::commands::serve] Aiden's Humidifier (31:05:D4:AD:FC:83:98:1D H7140)
[2024-01-17T18:45:03 INFO  govee::commands::serve]   Platform API: devices.types.humidifier. supports_rgb=true supports_brightness=true
[2024-01-17T18:45:03 INFO  govee::commands::serve]                 color_temp=None segment_rgb=None
[2024-01-17T18:45:03 INFO  govee::commands::serve]   Undoc: room=None supports_iot=true ble_only=false
[2024-01-17T18:45:03 INFO  govee::commands::serve]
[2024-01-17T18:45:03 INFO  govee::commands::serve] Olivia's Humidifier (1A:8C:D4:AD:FC:83:FD:92 H7140)
[2024-01-17T18:45:03 INFO  govee::commands::serve]   Platform API: devices.types.humidifier. supports_rgb=true supports_brightness=true
[2024-01-17T18:45:03 INFO  govee::commands::serve]                 color_temp=None segment_rgb=None
[2024-01-17T18:45:03 INFO  govee::commands::serve]   Undoc: room=None supports_iot=true ble_only=false
[2024-01-17T18:45:03 INFO  govee::commands::serve]
[2024-01-17T18:45:03 INFO  govee::commands::serve] H5104_104B (82:7E:C6:38:30:33:10:4B H5104)
[2024-01-17T18:45:03 INFO  govee::commands::serve]   Undoc: room=None supports_iot=false ble_only=true
[2024-01-17T18:45:03 WARN  govee::commands::serve]   Unknown device type. Cannot map to Home Assistant.
[2024-01-17T18:45:03 INFO  govee::commands::serve]
[2024-01-17T18:45:03 INFO  govee::commands::serve] Living Room (14:FA:60:74:F4:5A:79:AA H7142)
[2024-01-17T18:45:03 INFO  govee::commands::serve]   Platform API: devices.types.humidifier. supports_rgb=false supports_brightness=false
[2024-01-17T18:45:03 INFO  govee::commands::serve]                 color_temp=None segment_rgb=None
[2024-01-17T18:45:03 INFO  govee::commands::serve]   Undoc: room=None supports_iot=true ble_only=false
[2024-01-17T18:45:03 INFO  govee::commands::serve]
[2024-01-17T18:45:03 INFO  govee::commands::serve] H5104_4168 (B7:D5:CB:35:33:33:41:68 H5104)
[2024-01-17T18:45:03 INFO  govee::commands::serve]   Undoc: room=None supports_iot=false ble_only=true
[2024-01-17T18:45:03 WARN  govee::commands::serve]   Unknown device type. Cannot map to Home Assistant.
[2024-01-17T18:45:03 INFO  govee::commands::serve]
[2024-01-17T18:45:03 INFO  govee::commands::serve] H5104_5858 (47:D0:D7:38:30:33:58:58 H5104)
[2024-01-17T18:45:03 INFO  govee::commands::serve]   Undoc: room=None supports_iot=false ble_only=true
[2024-01-17T18:45:03 WARN  govee::commands::serve]   Unknown device type. Cannot map to Home Assistant.
[2024-01-17T18:45:03 INFO  govee::commands::serve]
[2024-01-17T18:45:03 INFO  govee::commands::serve] H5104_0A72 (53:CD:CB:35:33:35:0A:72 H5104)
[2024-01-17T18:45:03 INFO  govee::commands::serve]   Undoc: room=None supports_iot=false ble_only=true
[2024-01-17T18:45:03 WARN  govee::commands::serve]   Unknown device type. Cannot map to Home Assistant.
[2024-01-17T18:45:03 INFO  govee::commands::serve]
[2024-01-17T18:45:03 INFO  govee::commands::serve] M Bedroom Humidifier (15:09:D4:AD:FC:83:98:47 H7140)
[2024-01-17T18:45:03 INFO  govee::commands::serve]   Platform API: devices.types.humidifier. supports_rgb=true supports_brightness=true
[2024-01-17T18:45:03 INFO  govee::commands::serve]                 color_temp=None segment_rgb=None
[2024-01-17T18:45:03 INFO  govee::commands::serve]   Undoc: room=None supports_iot=true ble_only=false
[2024-01-17T18:45:03 INFO  govee::commands::serve]
[2024-01-17T18:45:03 INFO  govee::service::http] http server addr is <IP_ADDRESS>:8056
[2024-01-17T18:45:08 WARN  govee::hass_mqtt::enumerator] Do something about Mode nightlightScene for Aiden's Humidifier (31:05:D4:AD:FC:83:98:1D H7140) DeviceCapability { kind: Mode, instance: "nightlightScene", parameters: Some(Enum { options: [EnumOption { name: "Forest", value: Number(1), extras: {} }, EnumOption { name: "Ocean", value: Number(2), extras: {} }, EnumOption { name: "Wetland", value: Number(3), extras: {} }, EnumOption { name: "Leisurely", value: Number(4), extras: {} }, EnumOption { name: "Sleep", value: Number(5), extras: {} }] }), alarm_type: None, event_state: None }
[2024-01-17T18:45:08 WARN  govee::hass_mqtt::enumerator] Do something about Mode nightlightScene for Olivia's Humidifier (1A:8C:D4:AD:FC:83:FD:92 H7140) DeviceCapability { kind: Mode, instance: "nightlightScene", parameters: Some(Enum { options: [EnumOption { name: "Forest", value: Number(1), extras: {} }, EnumOption { name: "Ocean", value: Number(2), extras: {} }, EnumOption { name: "Wetland", value: Number(3), extras: {} }, EnumOption { name: "Leisurely", value: Number(4), extras: {} }, EnumOption { name: "Sleep", value: Number(5), extras: {} }] }), alarm_type: None, event_state: None }
[2024-01-17T18:45:08 WARN  govee::hass_mqtt::enumerator] Do something about Mode nightlightScene for M Bedroom Humidifier (15:09:D4:AD:FC:83:98:47 H7140) DeviceCapability { kind: Mode, instance: "nightlightScene", parameters: Some(Enum { options: [EnumOption { name: "Forest", value: Number(1), extras: {} }, EnumOption { name: "Ocean", value: Number(2), extras: {} }, EnumOption { name: "Wetland", value: Number(3), extras: {} }, EnumOption { name: "Leisurely", value: Number(4), extras: {} }, EnumOption { name: "Sleep", value: Number(5), extras: {} }] }), alarm_type: None, event_state: None }
[2024-01-17T18:45:08 INFO  govee::service::hass] Wait 3.6s for hass to settle on 72 entity configs
[2024-01-17T18:45:12 INFO  govee::service::hass] MQTT connected with status=CONNACK code 0: Connection Accepted.
[2024-01-17T18:45:23 INFO  govee::service::state] requesting update via Platform API Aiden's Humidifier (31:05:D4:AD:FC:83:98:1D H7140) None
[2024-01-17T18:45:24 WARN  govee::hass_mqtt::enumerator] Do something about Mode nightlightScene for Aiden's Humidifier (31:05:D4:AD:FC:83:98:1D H7140) DeviceCapability { kind: Mode, instance: "nightlightScene", parameters: Some(Enum { options: [EnumOption { name: "Forest", value: Number(1), extras: {} }, EnumOption { name: "Ocean", value: Number(2), extras: {} }, EnumOption { name: "Wetland", value: Number(3), extras: {} }, EnumOption { name: "Leisurely", value: Number(4), extras: {} }, EnumOption { name: "Sleep", value: Number(5), extras: {} }] }), alarm_type: None, event_state: None }
[2024-01-17T18:45:24 INFO  govee::service::state] requesting update via Platform API Olivia's Humidifier (1A:8C:D4:AD:FC:83:FD:92 H7140) None
[2024-01-17T18:45:24 WARN  govee::hass_mqtt::enumerator] Do something about Mode nightlightScene for Olivia's Humidifier (1A:8C:D4:AD:FC:83:FD:92 H7140) DeviceCapability { kind: Mode, instance: "nightlightScene", parameters: Some(Enum { options: [EnumOption { name: "Forest", value: Number(1), extras: {} }, EnumOption { name: "Ocean", value: Number(2), extras: {} }, EnumOption { name: "Wetland", value: Number(3), extras: {} }, EnumOption { name: "Leisurely", value: Number(4), extras: {} }, EnumOption { name: "Sleep", value: Number(5), extras: {} }] }), alarm_type: None, event_state: None }
[2024-01-17T18:45:24 INFO  govee::service::state] requesting update via Platform API Living Room (14:FA:60:74:F4:5A:79:AA H7142) None
Additional Logs
No response
Home Assistant Logs
No response
Anything else?
No response

delete the device and restart the addon.  Then share what you see in HA under that device

I deleted the device and purged the cache and restarted addon before log
submission. I just deleted and restarted addon, no change in UI.
Screenshots attached.
On Wed, Jan 17, 2024, 8:23 PM Wez Furlong @.***> wrote:

delete the device and restart the addon. Then share what you see in HA
under that device
—
Reply to this email directly, view it on GitHub
https://github.com/wez/govee2mqtt/issues/81#issuecomment-1897604420, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AAJ4ZCB6GCWLERHOPHQQUCLYPB2R5AVCNFSM6AAAAABB7NUVTOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOJXGYYDINBSGA
.
You are receiving this because you authored the thread.Message ID:
@.***>

There are no attachments here; I don't think github will add them via email.
Please also share the logs from the addon, and any mqtt related logs from home assistant.

Thanks; I think this is fixed in the release I just pushed. I recommend deleting the device so that you don't get left with all those buttons!

UI is much cleaner, thanks for that, but the entity for water tank empty still hasn't returned.

FWIW, I don't think there is an entity for an empty water tank. My humidifier doesn't have one. There is metadata in the API for mine that says that there is an available event, but those events do not currently work because of bugs on Govee's end (eg: https://github.com/wez/govee2mqtt/issues/79)
Please share the metadata for your device:

go to the device entry in for your device
Find the entity id of the Status entity that is listed under your space heater and get its entity name. The default is probably something like sensor.device_name_status.

Then evaluate the following home assistant template by visiting Developer Tools | Template, replacing the entity name with what yours actually is:
{{
    {
      "meta": state_attr('sensor.space_heater_status', 'platform_metadata'),
      "state": state_attr('sensor.space_heater_status', 'platform_state'),
    }
}}

It should output a large-ish json blob, please share that here.

I did have what appeared to be a working notification alerting me that the water was out with the auto-parameter mentioned in OP. It changed to 0 at the same time the water ran out, and once it was refilled it changed to 1. Perhaps this was reporting a different value that coincided with the tank being empty?
{
"meta": {
"capabilities": [
{
"alarmType": null,
"eventState": null,
"instance": "powerSwitch",
"parameters": {
"dataType": "ENUM",
"options": [
{
"name": "on",
"value": 1
},
{
"name": "off",
"value": 0
}
]
},
"type": "devices.capabilities.on_off"
},
{
"alarmType": null,
"eventState": null,
"instance": "workMode",
"parameters": {
"dataType": "STRUCT",
"fields": [
{
"dataType": "ENUM",
"defaultValue": null,
"fieldName": "workMode",
"options": [
{
"name": "Manual",
"value": 1
},
{
"name": "Custom",
"value": 2
},
{
"name": "Auto",
"value": 3
}
],
"required": true
},
{
"dataType": "ENUM",
"defaultValue": null,
"fieldName": "modeValue",
"options": [
{
"name": "Manual",
"options": [
{
"value": 1
},
{
"value": 2
},
{
"value": 3
},
{
"value": 4
},
{
"value": 5
},
{
"value": 6
},
{
"value": 7
},
{
"value": 8
},
{
"value": 9
}
],
"required": true,
"value": null
},
{
"defaultValue": 0,
"name": "Custom",
"required": false,
"value": null
},
{
"name": "Auto",
"range": {
"max": 80,
"min": 40
},
"required": true,
"value": null
}
],
"required": false
}
]
},
"type": "devices.capabilities.work_mode"
},
{
"alarmType": null,
"eventState": null,
"instance": "humidity",
"parameters": {
"dataType": "INTEGER",
"range": {
"max": 70,
"min": 40,
"precision": 1
},
"unit": "unit.percent"
},
"type": "devices.capabilities.range"
},
{
"alarmType": 51,
"eventState": {
"options": [
{
"message": "Lack of Water",
"name": "lack",
"value": 1
}
]
},
"instance": "lackWaterEvent",
"parameters": null,
"type": "devices.capabilities.event"
}
],
"device": "14:FA:60:74:F4:5A:79:AA",
"deviceName": "Living Room",
"sku": "H7142",
"type": "devices.types.humidifier"
},
"state": {
"capabilities": [
{
"instance": "online",
"state": {
"value": true
},
"type": "devices.capabilities.online"
},
{
"instance": "powerSwitch",
"state": {
"value": 1
},
"type": "devices.capabilities.on_off"
},
{
"instance": "workMode",
"state": {
"value": {
"modeValue": 1,
"workMode": 3
}
},
"type": "devices.capabilities.work_mode"
},
{
"instance": "humidity",
"state": {
"value": ""
},
"type": "devices.capabilities.range"
}
],
"device": "14:FA:60:74:F4:5A:79:AA",
"sku": "H7142"
}

Perhaps what you saw was someone at govee adding it by mistake, or during a test, and then removing it?
The metadata you shared looks very similar to that of my humidifier, but slightly better: yours actually has a range specified for Auto mode while mine has none.  The metadata that comes back from Govee's APIs seems terribly inconsistent.
There's no notification logic in govee2mqtt; I haven't gotten around to implementing it yet because the discussions on Govee's API forum indicate that it doesn't work yet.

Just to clarify, I was using an automation to monitor the state, that's how
I was getting the notifications.
Any value in rolling back my addon version to see if that entity returns?
On Thu, Jan 18, 2024, 7:57 AM Wez Furlong @.***> wrote:

Perhaps what you saw was someone at govee adding it by mistake, or during
a test, and then removing it?
The metadata you shared looks very similar to that of my humidifier, but
slightly better: yours actually has a range specified for Auto mode while
mine has none. The metadata that comes back from Govee's APIs seems
terribly inconsistent.
There's no notification logic in govee2mqtt; I haven't gotten around to
implementing it yet because the discussions on Govee's API forum indicate
that it doesn't work yet.
—
Reply to this email directly, view it on GitHub
https://github.com/wez/govee2mqtt/issues/81#issuecomment-1898432967, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AAJ4ZCA7CGTF3V2MVDOII6LYPEL5NAVCNFSM6AAAAABB7NUVTOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOJYGQZTEOJWG4
.
You are receiving this because you authored the thread.Message ID:
@.***>

There's no logic in the code that could possibly enable that, and never has been, so changing the version of the code won't change this. If was most likely a transient state in the metadata returned from Govee that is no longer there.

Note that "Auto Parameter" as an entity did exist, but it was associated with the workMode metadata that would have selected Auto mode.
With the metadata from your device, we can show a slider for the range 40-80 for auto mode, but need to write up some logic for that.
Perhaps the device reports an illegal (based on the metadata) 0 value when it has a problem condition?

FWIW, the latest update should give you a slider for Auto mode. I recommend deleting the device and restarting the addon for that to get picked up.
If that device does report 0 for that weird state, I'm not sure that I want to do anything about it: it's outside of the (very lightly) specified behavior of the API and is thus undefined behavior that I don't think we can rely on.

Thanks, I'll get the update done and will validate. I'm not concerned it's
reporting the 0 state, I was just using it to my advantage as I perceived
it to be the water out notification. My intention was to light up the RGB
lights red when it was out of water via an automation, but I can simply
rely on their mobile app notifications.
On Thu, Jan 18, 2024, 12:50 PM Wez Furlong @.***> wrote:

FWIW, the latest update should give you a slider for Auto mode. I
recommend deleting the device and restarting the addon for that to get
picked up.
If that device does report 0 for that weird state, I'm not sure that I
want to do anything about it: it's outside of the (very lightly) specified
behavior of the API and is thus undefined behavior that I don't think we
can rely on.
—
Reply to this email directly, view it on GitHub
https://github.com/wez/govee2mqtt/issues/81#issuecomment-1898947629, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AAJ4ZCDU2J7KEKRX7VAN2UTYPFOGHAVCNFSM6AAAAABB7NUVTOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOJYHE2DONRSHE
.
You are receiving this because you authored the thread.Message ID:
@.***>


Restore missing Traversable instance

… as caught by @phadej in #57
This instance was omitted by mistake when refactoring the
Control.Monad.Trans.Compose module to use GeneralizedNewtypeDeriving
in #52

I'd also note that GND is not Safe Haskell. Check

https://hackage.haskell.org/package/mmorph-1.1.3/docs/Control-Monad-Trans-Compose.html is safe
https://hackage.haskell.org/package/mmorph-1.1.4/docs/Control-Monad-Trans-Compose.html isn't

I'm not sure what your take on Safe Haskell, but I'm almost sure someone relies on mmorph being Safe.
Maybe a good idea to explicitly mark the main module as Safe and Compose module as Trustworthy.
Sorry for the flood of suggestions.

@phadej: Alright, I'll mark it Trustworthy in a separate pull request

@Gabriel439 thanks!

You're welcome! 🙂


Support for darwin_ARM64 (Apple Macbook Pro with M1 chip)

I'm still getting this error when running terraform init on my M1 mbp even though it seems like it's been resolved in https://github.com/aztfmod/terraform-provider-azurecaf/issues/95:
│ Error: Incompatible provider version
│
│ Provider registry.terraform.io/aztfmod/azurecaf v1.2.6 does not have a package available for your current platform, darwin_arm64.
│
│ Provider releases are separate from Terraform CLI releases, so not all providers are available for all platforms. Other versions of this provider may
│ have different platforms supported.

Can you please to add support of darwin_ARM64 (Apple Macbook Pro with M1 chip)?

Reopening

I cloned this and it builds perfectly in a M1 however when terraform tries to resolve the provider it seems the arch specific version is not published.
I noticed also that the releases page does not have "terraform-provider-azurecaf_1.2.8_darwin_arm64.zip"
Maybe it is a configuration issue on goreleaser action?

Closing as resolved in 1.2.9


The createsnapshot() of backup() will be executed repeatedly when err is nil

Steps to reproduce:
List the minimal actions needed to reproduce the behavior.

Analysis code Engine.Backup()

Expected behavior:
Jump out of the loop when err is nil
Actual behavior:
no break when err is nil
Environment info:

System info: Run uname -srm and copy the output here
InfluxDB version: Run influxd version and copy the output here
Other relevant environment details: Container runtime, disk info, etc

Config:
Copy any non-default config values here or attach the full config as a gist or file.

Logs:
Include snippet of errors in log.
Performance:
Generate profiles with the following commands for bugs related to performance, locking, out of memory (OOM), etc.
# Commands should be run when the bug is actively happening.
# Note: This command will run for at least 30 seconds.
curl -o profiles.tar.gz "http://localhost:8086/debug/pprof/all?cpu=true"
curl -o vars.txt "http://localhost:8086/debug/vars"
iostat -xd 1 30 > iostat.txt
# Attach the `profiles.tar.gz`, `vars.txt`, and `iostat.txt` output files.

This was fixed by https://github.com/influxdata/influxdb/pull/20527 in master and https://github.com/influxdata/influxdb/pull/19869 in master-1.x


Sniff::is_in_isset_or_empty(): improve code-style independence

Includes unit tests in the ValidatedSanitizedInput test case file.
Relates to #763

@WordPress-Coding-Standards/wpcs-admins Anything I can do to move this PR forward ?


EACCES Error relating to 7za when creating backup archive

Hi, when I run a backup I get the following error:
createZipArchive: spawn /tmp/.mount_JoplinPwiy47/resources/build/7zip/7za EACCES
The backup creates source files in my backup destination under a folder called 'joplin_active_backup_job'. This folder contains all of my notes as individual files. I assume this is a temporary copy before the archive is created.
At the same time the backup also creates an empty folder called 'JoplinBackup' in my backup destination.
Nothing relating to backups is written to $HOME/.config/joplin-desktop/logs.txt.
The following error is shown in activeBackup.log:
 [2024-01-23 17:38:29.143] [error] createZipArchive: spawn /tmp/.mount_JoplinPwiy47/resources/build/7zip/7za EACCES
There are no other errors in the activeBackup.log and the error above is the last entry in the log.
/tmp/.mount_JoplinPwiy47/resources/build contains the following files:
-rw-r--r-- 1 root root 1457384 Jan 18 22:05 7za
-rw-r--r-- 1 root root    3672 Jan 18 22:05 license.txt

If I go into a terminal and try to run 7za from this folder I get a 'Permission Denied' error. The same happens if I try to run 7za with sudo. I cannot make 7za executable as sudo. I assume this is normal behaviour and part of the AppImage sandboxing.
I have tried closing Joplin and deleting the entire /tmp/.mount_JoplinPwiy47. The folder is recreated when I next run Joplin but the EACCES error persists.
Changing the 'Temporary export path' to a folder within my user home folder does not remove the error.
I have the following backup configuration options:

Backup path: An empty directory within my home directory
Keep x backups: 100
Backup interval in hours: 24
Only on change: Ticked
Password protected backups: Unticked
Password: Not set
Loglevel: Verbose
Create archive: Yes, one archive
Compression level: Normal
Temporary export path: An empty directory within my home directory (not the same path as Backup path)
Backup plugins: Unticked
Export format: MD Frontmatter
Single JEX: Unticked
Command on Backup finish: Blank

I am running Joplin desktop version 2.14.10 on Kubuntu 23.10. Simple Backup is version 1.3.6.
Joplin 2.14.10 (prod, linux)
Sync Version: 3
Profile Version: 45
Keychain Supported: No
Revision: 3ed6ad5
Simple Backup: 1.3.6

Is this with the Buildin Backup Plugin oder with a seperated installed ?
I think it's about a snap installation?
Yes, the backup cannot continue because it has no access to 7za and is terminated

Hi I'm using the AppImage version of Joplin desktop from the Joplin web site.
I haven't installed any plugins myself, I'm the included 'Backup' plugin that came with the AppImage.

@personalizedrefrigerator Can you possibly help? Since you have customized something for the default installation on 7zip.

Thank you for reporting this! I can reproduce this on Ubuntu 23.10.
Because of code signing issues on MacOS, we bundle 7zip with Joplin (rather than with the .jpl file for Simple Backup).
Semi-related (but different) issues:

https://github.com/AppImage/AppImageKit/issues/1021
https://github.com/marktext/marktext/issues/1164#issuecomment-518206810

My guess would have been that /tmp is mounted as noexec. However, on my system, I'm able to create a subdirectory of /tmp, put an executable in it, and execute it (so this probably isn't a noexec issue).
One possible solution could be to copy 7zip/7za to a different location before executing it on Linux. For example, to a subdirectory of ~/.config/joplin-desktop/cache.

Also I wonder how that will work once the app is bundled with Snap?
Perhaps as a fallback we could simply not compress the backup if 7-zip fails?

Maybe check in advance if 7 zip is executable and if not deactivate the compression and password options (do not show).

I liked the idea of putting the 7za executable in ~/.config/joplin-desktop/cache or it could be temporarily put into the 'Temporary export path'.

Pull request: https://github.com/laurent22/joplin/pull/9780

I'm using the included 'Backup' plugin that came with the AppImage.

This should be Simple Backup v1.3.5 -- Joplin's default plugin build script points to commit bd49c665bf60c1e0dd9b9862b2ba69cad3d4c9ae which is version 1.3.5.
If the about screen shows version 1.3.6, there's probably a bug somewhere :). (For me, it shows version 1.3.5).

This should be fixed in version 2.14.11!

I've tested it in 2.14.11 and it works!
Thank you.

Also I wonder how that will work once the app is bundled with Snap?

I don't expect the 7za binary to be too problematic. I can either wrap around it, bundle the Ubuntu version, or patch the plugin itself since it's now essentially part of the core app; assuming it's even a problem, it might happen to work just fine.
I've tried to test it now to confirm but unfortunately the plugin when loaded from from the Joplin executable (I.E 2.14.x) doesn't initialise properly. The plugin is shown as installed and as built-in, but the config for the plugin in the options menu doesn't load at all.
As far as 2.13.x goes installing it manually, the functionality works just fine, so assuming I can figure out why the UI won't load, I'd expect the 2.14.x version to work fine too.

I've found the problem; the snap turns off Asar bundling because I copied the idea from the Flatpak. I believe the idea in the Flatpak is that by removing the bundling, the Flatpak update mechanism can more efficiently target specific files that have changed between releases. Snap updates don't work the same way and update (usually) via the delta's between two squashfs files, so for me it's trivial to just turn the asar bundling back on to fix the built-in Simple Backup plugin.
Once that's done, the snap works exactly as expected.
Strictly speaking, this is somewhat a Simple Plugin issue because the exact error was it was looking at the wrong path when Asar bundling is turned off, causing it to not identify the 7za file even though there is one, so other potential future bundled plugins could work fine with Asar bundling turned off.
On the other hand, it's a packaging issue, since all the official releases have Asar bundling turned on.
Long story short, the snap looks good but the Flatpak probably needs investigating separately for their Asar settings.

I've tried to test it now to confirm but unfortunately the plugin when loaded from from the Joplin executable (I.E 2.14.x) doesn't initialise properly. The plugin is shown as installed and as built-in, but the config for the plugin in the options menu doesn't load at all.

This might be fixed by https://github.com/laurent22/joplin/commit/b51e16c255821154bc00817df74177149160a03f, which removes duplicated logic for finding the location of the build/ directory at runtime. The original code for doing this, present in ElectronAppWrapper.ts, might work even if Asar bundling is turned off.


add e2e tests for SA setup

Test the SA setup using the command gcloud storage buckets add-iam-policy-binding.

Fixed in the commit https://github.com/GoogleCloudPlatform/gcs-fuse-csi-driver/commit/8670eeb95b40d3539c172ac31df6e2e12c37415b


docs:Moved AWS tab ahead in the list as per monthly download figures.

Description
AWS tab is currently last on the list, although the monthly download numbers are higher than some other providers. Moving the AWS tab ahead in the list as per the PyPI monthly download figures.
https://python.langchain.com/docs/integrations/providers/

Provider
Package
Downloads

Google VertexAI
langchain-google-vertexai
7.7M/month

OpenAI
langchain-openai
7.0M/month

Google Community
langchain-google-community
1.7M/month

AWS
langchain-aws
1.2M/month

Anthropic
langchain-anthropic
1.1M/month

should we also update to use ChatBedrockConverse(model="...") instead

We want to move to one ChatBedrock class, so users don't have to rename in their code. We will likely end up making ChatBedrockConverse --> ChatBedrock in the next minor release.


Error to add a license

Hello,
When I try to add a new license for a software product. I have the following message :
Server Error
A database programming error was detected while processing this request. Common causes include the following:

Database migrations missing. When upgrading to a new NetBox release, the upgrade script must be run to apply any new database migrations.
You can run migrations manually by executing python3 manage.py migrate from the command line.

Unsupported PostgreSQL version. Ensure that PostgreSQL version 12 or later is in use.
You can check this by connecting to the database using NetBox's credentials and issuing a query for SELECT VERSION().

The complete exception is provided below:

<class 'django.db.utils.ProgrammingError'>

column "stored_location_url" of relation "netbox_slm_softwarelicense" does not exist
LINE 1: ..."name", "description", "type", "stored_location", "stored_lo...
                                                             ^

Python version: 3.11.4
NetBox version: 3.6.3
Plugins:
  netbox_dns: 0.19.3
  netbox_slm: 1.5

However, I have the correct version of Postgres and of the plugin.
I've already seen in another issue that the problem was fixed but in my case, it doesn't work.
In advance, thank you for your answer.

Migrations 0006 and 0007 were not included in the release tar.gz for version v1.5.
I have patched it and released in version v1.5.1, will look at re-releasing v1.5.

Thank you for your answer @wkoot.
Finally, I modified the PostgresSQL Database (add a column "cluster_id") and yet it works.
IDEM for softaware installations.

Just tested 1.5.1 from PyPu with success


Interceptor doesn't work for DioError.type = cancel

Interceptor have no effect on dio error when you cancel request.
version: 4.0.6
Example
class ErrorInterceptor extends Interceptor {
  @override
  void onError(DioError err, ErrorInterceptorHandler handler) {
    if (err.type == DioErrorType.cancel) {
      handler.next(CancelledException());
    } else {
      handler.next(err);
    }
  }
}

When register interceptor and try to catch an error it always has a type = DioError instead of CancelledException whenever request is cancelled.

cc @ueman @kuhnroyal Got any opinion about handling cancellation in interceptors? I do a test with the snippet and it's indeed not handled the cancellation.

Can this be re-opened? It seems it's still an issue.
I'm unable to catch a DioError of type cancel in an interceptor.


Nodemailer needs to be updated

SMTP localhost transport appears to broken with this version of nodemailer, updating to the latest version fixed it. Also nodemailer-direct-transport and nodemailer-smtp-transport is likely no longer necessary.

Thanks!


tracing: bump digitalmarketplace-apiclient dependency to 15.0.0

This should bring in support for zipkin span ids
https://trello.com/c/exuNFb7A/357-zipkin-headers-pt2-api-client
https://trello.com/b/ioXxSA1U/tech-debt

I... think... so....


There are no entries for "" and ":map-cmd" in doc/tags

Perhaps there's nothing to add to the issue title.
Vim 8.2.2022.

https://github.com/vim/vim/blob/master/runtime/doc/tags#L3511
https://github.com/vim/vim/blob/master/runtime/doc/tags#L2728

@brammool Oh, sorry, since 8.2.2022 is the latest release at https://github.com/vim/vim-win32-installer/releases, I thought that's where I'd find the most up-to-date doc/tags. I don't compile Vim from the source and completely forgot about its existence at https://github.com/vim/vim/ ...


Failure to generate correctly for very small masks

Hi, thank you for your interesting work!
I wanted to generate a very small object in the image, so I input a very small mask(4-5pixels wide), but it didn't generate an object for the prompt. So I have 2 question.

Is there something I need to modify (e.g., parameters, pre-processing, etc..) to generate properly even with a very small mask?
I would be interested in your thoughts on why it fails to generate from a very small mask.

Thanks!

Hi,
Thank you for your interest in our work.
We actually tackled this problem of small masks in our follow-up work Blended Latent Diffusion.
For more details, please look for "Progressive Mask Shrinking" in this paper.
Best,
Omri


i am able to send info( exec node) to node red and parse the yaml file there.

But was info can i use ?  not sure what i should look at :P

Can you give me more context and detail? I'm not sure how to help you.

Closing due to inactivity.


[BEAM-9727] Automatically set required experiment flags for dataflow runner v2.

Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

[ ] Choose reviewer(s) and mention them in a comment (R: @username).
[ ] Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.
[ ] Update CHANGES.md with noteworthy changes.
[ ] If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

R: @angoenka

Thanks a lot Yichi! Could we also ensure this change works with the default bq_sink flag in https://github.com/apache/beam/pull/11309? Basically, we should be able to run a batch python pipeline with BQ sink with just --use_runner_v2 option. Ideally, with your current change and the one in PR-11309, we should be able to run it e2e w/o any extra flags.

R @lukecwik @robertwb

It doens't look like Ankur's comments have been addressed.

Thanks a lot Yichi! Could we also ensure this change works with the default bq_sink flag in #11309? Basically, we should be able to run a batch python pipeline with BQ sink with just --use_runner_v2 option. Ideally, with your current change and the one in PR-11309, we should be able to run it e2e w/o any extra flags.

I've validated with an example pipeline using BigQuery sink, and asserted on the beam fn api flag in apply_WriteToBigQuery where the flag is used.

trigger tests

retest this please

retest this please

Consider adding the logic here instead:
https://github.com/apache/beam/blob/79b2d87b59819ee55fb8600e8a845c6ba5b98d64/sdks/python/apache_beam/pipeline.py#L206
This would add the experiment slightly earlier then when the first ptransform is applied.

I initially considered to add it into pipeline.py following this check, but feel that the logic is too dataflow-specific to be added here.

LGTM

Consider adding the logic here instead:
https://github.com/apache/beam/blob/79b2d87b59819ee55fb8600e8a845c6ba5b98d64/sdks/python/apache_beam/pipeline.py#L206
This would add the experiment slightly earlier then when the first ptransform is applied.

I initially considered to add it into pipeline.py following this check, but feel that the logic is too dataflow-specific to be added here.

sgtm, in the worst case we can tell users to use a longer list of experiments if we find a problem later.


Readme Content Verification - need to format readmes to match template doc

The following data-plane items need to be addressed. Validation has failed on the following readme list items.
tl;dr: Readmes should have at least have sections that correspond to the main sections as defined in the template readme.
This is what the tool checks, but the ideal scenario is the readme is reworked to be somewhat like the readme example.
For a rundown on what you need to do to resolve these breaking issues ASAP, check out aka.ms/azure-sdk-analyze-failed
ITEMS
31 readmes have at least one missing required section.

[ ] \README.rst is missing headers with patterns:

Azure .+ client library for Python
^Getting started$
^Key concepts$
^Examples$
^Troubleshooting$
^Next steps$
^Contributing$

(the items below have identical failures as the root readme as well, explicit list omitted for brevity)

[ ] sdk\attestation\azure-attestation\README.md
[ ] sdk\synapse\azure-synapse\README.md
[ ] \azure-applicationinsights\README.rst
[ ] \azure-batch\README.rst
[ ] \azure-cognitiveservices-knowledge-nspkg\README.rst
[ ] \azure-cognitiveservices-knowledge-qnamaker\README.rst
[ ] \azure-cognitiveservices-language-luis\README.rst
[ ] \azure-cognitiveservices-language-nspkg\README.rst
[ ] \azure-cognitiveservices-language-spellcheck\README.rst
[ ] \azure-cognitiveservices-language-textanalytics\README.rst
[ ] \azure-cognitiveservices-search-autosuggest\README.rst
[ ] \azure-cognitiveservices-search-customimagesearch\README.rst
[ ] \azure-cognitiveservices-search-customsearch\README.rst
[ ] \azure-cognitiveservices-search-entitysearch\README.rst
[ ] \azure-cognitiveservices-search-imagesearch\README.rst
[ ] \azure-cognitiveservices-search-newssearch\README.rst
[ ] \azure-cognitiveservices-search-nspkg\README.rst
[ ] \azure-cognitiveservices-search-videosearch\README.rst
[ ] \azure-cognitiveservices-search-visualsearch\README.rst
[ ] \azure-cognitiveservices-search-websearch\README.rst
[ ] \azure-cognitiveservices-vision-computervision\README.rst
[ ] \azure-cognitiveservices-vision-contentmoderator\README.rst
[ ] \azure-cognitiveservices-vision-customvision\README.rst
[ ] \azure-cognitiveservices-vision-face\README.rst
[ ] \azure-cognitiveservices-vision-nspkg\README.rst
[ ] \azure-eventgrid\README.rst
[ ] \azure-graphrbac\README.rst
[ ] \azure-keyvault\README.rst
[ ] \azure-loganalytics\README.rst
[ ] \azure-servicebus\README.rst
[ ] \azure-servicefabric\README.rst
[ ] \azure-servicemanagement-legacy\README.rst

Hii I would want to contribute please guide me further

Hii I would want to contribute please guide me further

Hey @Prernajha2609, apologies for the late response, I've been quite buried under an upcoming release.
We built a markdown scanner that can evaluate documents and ensure that they follow the basic structure that we decide. In this case, we have decided that we want our readmes to at least have the major sections:

Azure .+ client library for Python
^Getting started$
^Key concepts$
^Examples$
^Troubleshooting$
^Next steps$
^Contributing$

Which pans out to markdown that follow general shape of:
# Azure storage blob client library for Python
## Getting Started
<content>
## Key Concepts
<content>
<... other headers follow>

This is a simple proxy check to ensure that the readmes cover topics that we have decided are important.
If you're still interested in contributing, I would recommend that you pick a single readme from the above list and start converting it to the shape that we laid out above.
Other readmes to reference:

azure-core
azure-appconfiguration

If you do end up contributing a readme update, please @ me in the PR! I'm much more on top of notifications nowadays.

Hi , I would also like to work on this issue.

Instructions are above! Contributions are always welcome 👍

@scbedd can provide me a resource on how to run the markdown scanner ?

Closing, since this should be addressed in the python generator for the listed libraries


Embedded Fonts Not Rendering

I'm using the package in a CloudFlare worker and running into issues with rendering embedded fonts.
Example SVG:

Note that the font is embedded using a data uri.
Output:

I'm having this issue as well. Not in a Cloudflare worker.


Update the release script [skip ci]

Argument for the spark version of the final build and aggregation
Signed-off-by: Tim Liu<EMAIL_ADDRESS>

build


Keycloak Chart having Ingress issues?

Is this a request for help?:
No
Is this a BUG REPORT or FEATURE REQUEST? (choose one):
BUG REPORT
Version of Helm and Kubernetes:
K8 1.9 and helm 2.8.0
Which chart:
incubator/keycloak
What happened:
Created Ingress, but only produces "404 - Not Found". It isn't the Normal backend 404, so it's configuring to the /keycloak URL I set, but only 404. If I create a NodePort and hit directly, it comes up fine. Other services using the ingress controller are working fine under several other urls.
What you expected to happen:
Keycloak UI to display on the browser.
How to reproduce it (as minimally and precisely as possible):
helm install --name keycloak -f ./keycloak.values.yaml incubator/keycloak
keycloak:
image:
tag: 3.4.1.Final
username: ""
password: ""
replicas: 3
service:
type: "NodePort"
podAntiAffinity: "hard"
ingress:
enabled: true
path: "/keycloak"
hosts: []
rbac:
create: true
serviceAccount:
create: true
name: "keycloak"
postgresql:
postgresPassword: ""
Anything else we need to know:
No

Why did you set the ingress path to /keycloak? This probably won't work. Leave it at the default, which is /.

/assign

Then why even have the option? It's a proxy server. I don't want it to root at the proxy server.

To test though, we created a CNAME host to the ingress separate from the rest of the ingress services. But it still barfs at:
WE'RE SORRY ...
Invalid parameter: redirect_uri

FYI it does work through a NodePort

The chart uses the standard Keycloak Docker image which runs Keycloak at /. You can change this using JBoss CLI. You would then also have to adapt the ingress pass. Otherwise leave it at the default. I just tested it successfully with an Nginx ingress controller on a GKE cluster. Works as expected.

Still getting:
WE'RE SORRY ...
Invalid parameter: redirect_uri
Fresh deploy with ingress set to true and a hostname.

I found the issue. Your deploy has one scenario it doesn't seem to handle well. I have ingress at port 80, and instead terminate SSL at port 443 on my HAProxy server. Because port 80 is not open, it is having a fit about the HAProxy redirection.. After adding the HTTPS URI as a valid URL, it now seems to work, but it took opening a port 80 on my LB to even get to the admin console and make the change in the UI.. Is there any way to handle this or am I missing something? Thanks

I'm not sure I fully understand your issue.

The ingress server only operates on a non-SSL port in this configuration. The HAProxy LB is where the SSL terminates. Keycloak during the install, is given the http:// as an authorization, but the https:// is not. So it gives that "Invalid Parameter" response.... Anyways. Thanks.

Anyways, I found a way around it. Thanks...

I am seeing the exact same error with a very simple, non-replicated configuration using the most recent (4.0.0) chart.  The same configuration using the previous (3.4.0) version of the chart works just fine.  I'll log a fresh issue with the reproduction info (a simple description of which is in #8355 )

@joshskains I have the same issue you had (using AWS NLB as the Load Balancer, to an nginx ingress-controller that handles tls termination for me). I have deployed keycloak temporarily with http (removed tls.hosts in my values yml for keycloak) to work around the issue.  But I cannot figure out where to add https:// as an authorization in the UI as you mention above on Mar 12. Can you enlighten me on that?
Also, it seems to me that this type of setup up would be fairly common on Kubernetes so perhaps should be handled better, if at all possible, by this chart and perhaps this issue should be reopened for it.
(Note I'm running keycloak 4.5.0.Final with chart 4.0.1

For future travelers: the solution to this (from #8355) it to set:
keycloak:
  extraEnv: |
    - name: PROXY_ADDRESS_FORWARDING
      value: "true"

In your values.yaml

Is it possible to change the ingress path to /keycloak?
Anyone know the NginX ingress annotations and keycloak env/settings I need to use to achieve this?


Work in progress: Make Hugo work with tailwindcss-jit

Fixes #8343

This is very much a work in progress. Some notes:

This currently works on the basic level, and I have a test site where the build time goes from 3s to about 700ms, which is fine and dandy
But because now the "rebuild trigger" now is mostly HTML templates, we got a challenge re. when to rebuild CSS
That is solvable, but it would also bee cool to use the incremental build feature, which should be possible by having the PostCSS process being long-lived.

Maybe one way this could be solved if PostCSS would run after writeStats is completed, and we could reuse the hugo_stats.json to tell PostCSS that the change has occurred like I was trying in https://github.com/gohugoio/hugo/issues/8343#issuecomment-1038989247 but in native way? I thought PostProcess would help, but it looks like writeStats runs after PostProcess


nixos/tests/mysqlbackup: fix non-deterministic failure

Motivation for this change
Test sometimes failed on Hydra as it looked for a backup file that was not yet created.
Fixed by  waiting for backup to finish and backup file to appear.

@GrahamcOfBorg eal

@GrahamcOfBorg test mysql-backup

No attempt on aarch64-linux (full log)
The following builds were skipped because they don't evaluate on aarch64-linux: tests.mysql-backup
Partial log (click to expand)
Cannot nix-instantiate `tests.mysql-backup' because:
error: attribute 'mysql-backup' in selection path 'tests.mysql-backup' not found

No attempt on x86_64-linux (full log)
The following builds were skipped because they don't evaluate on x86_64-linux: tests.mysql-backup
Partial log (click to expand)
Cannot nix-instantiate `tests.mysql-backup' because:
error: attribute 'mysql-backup' in selection path 'tests.mysql-backup' not found

@GrahamcOfBorg test mysqlBackup

Success on aarch64-linux (full log)
Attempted: tests.mysqlBackup
Partial log (click to expand)
master: exit status 1
syncing
master: running command: sync
master: exit status 0
test script finished in 25.43s
cleaning up
killing master (pid 627)
vde_switch: EOF on stdin, cleaning up and exiting
vde_switch: Could not remove ctl dir '/build/vde1.ctl': Directory not empty
/nix/store/dy4xkwa79864m5s80x58i22x6c32v1lw-vm-test-run-mysql-backup

Success on x86_64-linux (full log)
Attempted: tests.mysqlBackup
Partial log (click to expand)
master: exit status 1
syncing
master: running command: sync
master: exit status 0
test script finished in 23.93s
cleaning up
killing master (pid 593)
vde_switch: EOF on stdin, cleaning up and exiting
vde_switch: Could not remove ctl dir '/build/vde1.ctl': Directory not empty
/nix/store/4ffpx2ma970qdvlzxfar9z4dbbbj6y2v-vm-test-run-mysql-backup


Can support play other m3u8 video

Can support play other m3u8 video?

how to play other m3u8 and mp4??