Trouble connecting to cassandra with latest cyanite release

I'm having trouble starting up cyanite on:
jdk1.8.0_25-1.8.0_25-fcs.x86_64
Cassandra 2.1
cyanite-0.5.1
Centos 6.6
I see a warning then an error. In my store stanza I specify username, password, keyspace and cluster. I downloaded the latest cyanite, from master.  I've also verified I can connect to the cassandra cluster from the host using the username and password, to the cluster. So it is not a network or auth issue.
I've dug around a bit and tried different things but so far I get the same behavior. If I remove the username/password I get an authentication error. I was/am able to connect using an older version of cyanite. I did drop and recreate the keyspace and verified it is up to date. I also tried adding type: 'cassandra-v2' to the store section and that did not resolve the issue.
Any help or suggestion appreciated.
store:
cluster: '<IP_ADDRESS>'
keyspace: 'metric'
username: foo
password: bar
java -jar /tmp/cyanite/target/cyanite-0.5.1-standalone.jar -f /etc/cyanite.yaml
......
WARN [2015-10-16 17:28:40,017] main - io.cyanite uncaught exception
clojure.lang.ExceptionInfo: Error in component :store in system clojure.lang.PersistentArrayMap calling #'com.stuartsierra.component/start
at clojure.core$ex_info.invokeStatic(core.clj:4610) ~[cyanite-0.5.1-standalone.jar:na]
at clojure.core$ex_info.invoke(core.clj) ~[cyanite-0.5.1-standalone.jar:na]
at com.stuartsierra.component$try_action.invokeStatic(component.cljc:119) ~[cyanite-0.5.1-standalone.jar:na]
at com.stuartsierra.component$try_action.invoke(component.cljc) ~[cyanite-0.5.1-standalone.jar:na]
at com.stuartsierra.component$update_system$fn__317.invoke(component.cljc:139) ~[cyanite-0.5.1-standalone.jar:na]
at clojure.lang.ArraySeq.reduce(ArraySeq.java:114) ~[cyanite-0.5.1-standalone.jar:na]
at clojure.core$reduce.invokeStatic(core.clj:6536) ~[cyanite-0.5.1-standalone.jar:na]
at clojure.core$reduce.invoke(core.clj) ~[cyanite-0.5.1-standalone.jar:na]
at com.stuartsierra.component$update_system.invokeStatic(component.cljc:135) ~[cyanite-0.5.1-standalone.jar:na]
at com.stuartsierra.component$update_system.doInvoke(component.cljc) ~[cyanite-0.5.1-standalone.jar:na]
at clojure.lang.RestFn.invoke(RestFn.java:445) ~[cyanite-0.5.1-standalone.jar:na]
at com.stuartsierra.component$start_system.invokeStatic(component.cljc:163) ~[cyanite-0.5.1-standalone.jar:na]
at com.stuartsierra.component$start_system.invoke(component.cljc) ~[cyanite-0.5.1-standalone.jar:na]
at com.stuartsierra.component$start_system.invokeStatic(component.cljc:161) ~[cyanite-0.5.1-standalone.jar:na]
at com.stuartsierra.component$start_system.invoke(component.cljc) ~[cyanite-0.5.1-standalone.jar:na]
at io.cyanite$_main.invokeStatic(cyanite.clj:103) ~[cyanite-0.5.1-standalone.jar:na]
at io.cyanite$_main.doInvoke(cyanite.clj) ~[cyanite-0.5.1-standalone.jar:na]
at clojure.lang.RestFn.applyTo(RestFn.java:137) ~[cyanite-0.5.1-standalone.jar:na]
at io.cyanite.main(Unknown Source) ~[cyanite-0.5.1-standalone.jar:na]
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /<IP_ADDRESS>:9042 (com.datastax.driver.core.ConnectionException: [/<IP_ADDRESS>:9042] Unexpected error during transport initialization (java.lang.NullPointerException)))
Debug did show a little more
DEBUG [2015-10-16 17:21:47,092] cluster1-nio-worker-0 - com.datastax.driver.core.Connection Connection[/<IP_ADDRESS>:9042-1, inFlight=0, closed=false] Connection opened successfully
DEBUG [2015-10-16 17:21:47,116] cluster1-nio-worker-0 - com.datastax.shaded.netty.util.Recycler -Dio.netty.recycler.maxCapacity.default: 262144
DEBUG [2015-10-16 17:21:47,153] cluster1-nio-worker-0 - com.datastax.driver.core.Host.STATES Defuncting Connection[/<IP_ADDRESS>:9042-1, inFlight=0, closed=false] because: [/<IP_ADDRESS>:9042] Unexpected error during transport initialization (java.lang.NullPointerException)

Hi @lrsmith,
Can you paste your indented config here ?

logging:
level: debug
console: true
files:
- "/tmp/cyanite.log"
inputs:

type: carbon
port: 2003
type: pickle
port: 2004

api:
port: 8080
engine:
rules:
default: [ "5s:1h" ]
store:
cluster: '<IP_ADDRESS>'
keyspace: 'metric'
username: 'my_user'
password: 'my_password'

@lrsmith can you paste it again with ``` around it, so the indent is preserved

Fixed it above. thanks.

@lrsmith The error is due to an unreachable cluster. The error is a bit buried in the stack-trace:
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /<IP_ADDRESS>:9042 (com.datastax.driver.core.ConnectionException: [/<IP_ADDRESS>:9042] Unexpected error during transport initialization (java.lang.NullPointerException)))

@pyr I've verified with the cqlsh command, on the host in question, that I can actually connect to the cluster and the metric database, with the user and password from the config. I'll double check but it only seem to by the cyanite code that is having the problem.

@lrsmith I was handing out an incorrect map to the underlying cassandra driver. Sorry about this!

pyr. Thank you everything looks much better now. Thanks


Test Python 3.11 on Linux, Windows and Mac, add 3.12-dev

Update tests for 3.11 and 3.12-dev. Update dependencies since flake8 was not compatible with Python 3.12.
Only after making the changes, I noticed there was already #329. Since there has been no release since, I anyway create this pull request in hopes it'll help get the release with 3.11 support sooner rather than later.

fixes #327

Checklist:

[ ] Add tests that demonstrate the correct behavior of the change. Tests should fail without the change.
[ ] Add or update relevant docs, in the docs folder and in code.
[X] Add an entry in CHANGES.rst summarizing the change and linking to the issue.
[ ] Add .. versionchanged:: entries in any relevant code docs.
[X] Run pre-commit hooks and fix any issues.
[X] Run pytest and tox, no tests failed.

#345


Handle share API error

Summary | Résumé
Adds an error message for failed API requests to the share endpoint

Fixes: #1819
Test instructions | Instructions pour tester la modification

Via the share modal - force an error for the api endpoint
View error message

Pull Request Checklist
Please complete the following items in the checklist before you request a review:

[ ] Have you completely tested the functionality of change introduced in this PR? Is the PR solving the problem it's meant to solve within the scope of the related issue?
[ ] The PR does not introduce any new issues such as failed tests, console warnings or new bugs.
[ ] If this PR adds a package have you ensured its licensed correctly and does not add additional security issues?
[ ] Is the code clean, readable and maintainable? Is it easy to understand and comprehend.
[ ] Does your code have adequate comprehensible comments? Do new functions have docstrings?
[ ] Have you modified the change log and updated any relevant documentation?
[ ] Is there adequate test coverage? Both unit tests and end-to-end tests where applicable?
[ ] If your PR is touching any UI is it accessible? Have you tested it with a screen reader? Have you tested it with automated testing tools such as axe?

@anikbrazeau --- we might want to change the content here but I added a placeholder for now
https://github.com/cds-snc/platform-forms-client/pull/1829/files#diff-a6e486b021382fa7935492752ec9890787007f55c22fdc5c300ec95e11355a7bR503


pylance seems to expect a typing syntax for some types such as 'dict' - e.g. x = (dict,)

Environment data

Windows-10-10.0.18362-SP0
python: 3.9.1 (tags/v3.9.1:1e5d33e, Dec  7 2020, 17:08:21) [MSC v.1927 64 bit (AMD64)]
Visual Code Studio: 1.53.2
extension pylance: v2021.2.1
type checking mode: strict

Expected behaviour
x: tuple[type] = (dict,) -> no problem
y: tuple[type] = (dict[str, str],) -> a problem
Actual behaviour
The exact reverse.
But maybe my expectations are wrong.
Thank you for your great tool!
Code Snippet / Additional information
import re
import typing

x: tuple[type] = (dict,)
    # pylance reports a problem: reportUnknownVariableType
    #   Type of "x" is partially unknown
    #       Type of "x" is "tuple[Type[dict[Unknown, Unknown]]]"
print(type(x[0]))
    # output is: <class 'type'>

y: tuple[type] = (dict[str, str],)
    # Here pylance does not report a problem.
    # But the created variable is quite different and cannot be used in e.g. isinstance(myvar, y)
print(type(y[0]))
    # output is: <class 'types.GenericAlias'>

# pylance also reports the problem for types such as 'list', 're.Pattern', 'collections.Counter', but not for 'tuple' and 'set'

# Is there a proper way to avoid the problem? Without hiding it such as:

z = typing.cast(tuple[type], (dict,))
t: tuple[type] = (dict,) # type: ignore
w: typing.Any = (dict,) # A local bandage, since it will reappear later when w is argument of a function expecting a tuple[type, ...] parameter

# Pattern behaves more strangely:

a: typing.Any = 'x'
b = isinstance(a, re.Pattern)
    # pylance reports a problem: reportUnknownMemberType
    #   Type of "Pattern" is partially unknown
    #       Type of "Pattern" is "Type[Pattern[Unknown]]"

c = isinstance(a, typing.Pattern)
    # pylance reports a problem: reportUnknownMemberType
    #   Type of "Pattern" is partially unknown
    #       Type of "Pattern" is "Type[Pattern[Unknown]]"

from typing import Pattern
d = isinstance(a, Pattern)
    # but surprisingly not here.

e = isinstance(a, re.Pattern[str])
    # Neither here, where execution fails:
    #   Traceback (most recent call last):
    #       File "test-typing.py", line 76, in <module>
    #           e = bool(isinstance(a, re.Pattern[str]))
    #   TypeError: isinstance() argument 2 cannot be a parameterized generic

I'm a bit confused by your expectations.
x: tuple[type] = (dict,) -> no problem

In the above, this is "fine", but you appear to be in strict mode, so it's telling you that you have dict (which is generic) and have not specified its type vars, so they are inferred as "Unknown" and a warning appears. I believe that in basic mode, this code would type check without error. Strict is more strict about this.
y: tuple[type] = (dict[str, str],) -> a problem

In the above, why is there a problem in this case? This is a type, and in newer versions of python, dict is subscritable just like typing.Dict (as the intent is for everyone to start using the builtin types).
The same goes for the other types; in strict mode, we warn about "Unknown", and those types are generic. I can see how isinstance(a, re.Pattern) may be odd, though, since that's a real class, but I think this is to be expected in strict mode.

Let's try this way:
I am adding 'types' to a bunch of python code lines.
'strict mode' generates a lot of pylance problems that I am progressively solving.
I discover real bugs that I am fixing too: this is the actual goal together with improving future maintenance.
Let's start with these non-typed 3 lines:
def check(v, t):
    return isinstance(v, t)
b = check('x', (dict,))

The function becomes:
def check(v: typing.Any, t: tuple[type, ...]) -> bool:
    return isinstance(v, t)

but pylance reports UnknownArgumentType (not in basic mode) with this:
b = check('x', (dict,))

and python fails with this:
b = check('x', (dict[str, str],))

However I know that I can put dust under the carpet with this:
b = check1('x', (dict,)) # type: ignore

I understand from your answer that there is no bug in here.
So what is the correct way to solve the pylance problem and that does not make python fail?
Do you mean I have to wait for newer versions of python (3.10)?

I see, yes, to be able to subscript I think you may need 3.10 (I had thought 3.9 was sufficient).
I can see how trying to use types in isinstance calls and seeing the Unknown type warning is a little strange. @erictraut may have a better piece of guidance when he is around.
This isn't totally related, but check would be cleanly represented with a TypeGuard (likely coming in 3.10 too: https://www.python.org/dev/peps/pep-0647/), but that doesn't address the Unknown messages.

Yeah, it's unfortunate that isinstance doesn't support subscripted forms. I specifically disable the reportUnknownVariableType check for the second argument passed to isinstance. That approach doesn't work in your code because you're not passing dict directly as an argument; you're instead adding it to a tuple and iterating over that tuple when calling isinstance.
Here are the options I can suggest:

Use a different pattern within your code so you don't use a tuple of generic types.
Disable the reportUnknownVariableType by adding a comment to the top of this source file: # pyright: reportUnknownVariableType=false
Disable the diagnostics on specific lines using # type: ignore.
Disable strict type checking mode.

I just noticed that your example demonstrates that you're seeing the problem for isinstance when you pass Pattern as the second argument. That looks like a bug to me. I'll investigate further.
I also noticed in your comments that the "missing type arguments" diagnostic is not appearing for tuple and set. That's another apparent bug that needs investigation.

The answer suits me very well
Thanks to both of you.


[control plane][FE] "OK" button in select panel of mapping page should be always visible

Issue description:
Now in select panel of mapping page, when API list to be selected is very long, user has scroll down to the end of list to view "OK" button and click it.

Expected:
"OK" button in select panel of mapping page should be always visible

Sometimes the panel header is invisible too. The panel header and footer (with OK button" should be frozen and always be visible like a standard drawer.

pass


Ensure Progress bar works on Windows

In https://typedrawers.com/discussion/comment/62849/#Comment_62849 a user writes,

there’s no way to make the progress bar work [on windows]. So I always have to use -s to deactivate it.

I'm sure that is annoying :)

I wrote the comment on typedrawers. Sorry, I misspelled: I have to use -n and not -s.
Here's the full error:
Traceback (most recent call last):
  File "C:\Users\Cesare\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 196, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "C:\Users\Cesare\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File "C:\Users\Cesare\AppData\Local\Programs\Python\Python310\Scripts\fontbakery.exe\__main__.py", line 7, in <module>
  File "C:\Users\Cesare\AppData\Local\Programs\Python\Python310\lib\site-packages\fontbakery\cli.py", line 55, in main
    run_profile_check(subcommand_module[6:])
  File "C:\Users\Cesare\AppData\Local\Programs\Python\Python310\lib\site-packages\fontbakery\cli.py", line 28, in run_profile_check
    sys.exit(check_profile_main(module.profile))
  File "C:\Users\Cesare\AppData\Local\Programs\Python\Python310\lib\site-packages\fontbakery\commands\check_profile.py", line 355, in main
    distribute_generator(status_generator, [reporter.receive for reporter in reporters])
  File "C:\Users\Cesare\AppData\Local\Programs\Python\Python310\lib\site-packages\fontbakery\checkrunner.py", line 595, in distribute_generator
    target(item)
  File "C:\Users\Cesare\AppData\Local\Programs\Python\Python310\lib\site-packages\fontbakery\reporters\__init__.py", line 132, in receive
    self._output(event)
  File "C:\Users\Cesare\AppData\Local\Programs\Python\Python310\lib\site-packages\fontbakery\reporters\terminal.py", line 189, in _output
    text = self._render_event(event)
  File "C:\Users\Cesare\AppData\Local\Programs\Python\Python310\lib\site-packages\fontbakery\reporters\terminal.py", line 601, in _render_event
    self._render_event_async(print, event)
  File "C:\Users\Cesare\AppData\Local\Programs\Python\Python310\lib\site-packages\fontbakery\reporters\terminal.py", line 593, in _render_event_async
    self._render_event_sync(print, event)
  File "C:\Users\Cesare\AppData\Local\Programs\Python\Python310\lib\site-packages\fontbakery\reporters\terminal.py", line 400, in _render_event_sync
    self.stdout.write(text)
  File "C:\Users\Cesare\AppData\Local\Programs\Python\Python310\lib\site-packages\fontbakery\reporters\terminal.py", line 125, in write
    self.flush()
  File "C:\Users\Cesare\AppData\Local\Programs\Python\Python310\lib\site-packages\fontbakery\reporters\terminal.py", line 131, in flush
    progressbar, reset_progressbar = self._draw_progressbar()
  File "C:\Users\Cesare\AppData\Local\Programs\Python\Python310\lib\site-packages\fontbakery\reporters\terminal.py", line 305, in draw_progressbar
    columns = int(columns_entry[0].split()[1])
IndexError: list index out of range

@ftCLI thanks for the traceback!! That's very helpful

Hi @ftCLI I just answered in https://github.com/googlefonts/fontbakery/issues/4189#issuecomment-1594355499 and it seems like your latest screenshot is related.
Could you try to turn off colors with -C? And if you are brave, try to get ANSI escape codes working in PowerShell using this documentation: https://learn.microsoft.com/en-us/powershell/module/microsoft.powershell.core/about/about_ansi_terminals?view=powershell-7.3

Yeah, the progressbar also uses ANSI escape codes, thus, so far -n is also required if these are not working.

I was actually able to get it work by using the new windwos terminal app.

I reckon #4447 will fix this, but I can't test on windows.

I reckon #4447 will fix this, but I can't test on windows.

Works on Windows 10 21H2


Unable to filter containers using "nerdctl ps -a" on Windows

Description
Unable to list the IDs of all containers that have exited on Windows
Steps to reproduce the issue
Run the command:
nerdctl ps -a --filter "status=exited" --format "{{.ID}}"
Describe the results you received and expected
Actual result:
time="2024-06-13T14:04:32+03:00" level=warning msg="no running task found: task 42c3fc550318cfb3ac5bc5fd4d09f8d29f8e3fd7b5b97c00fa400eee277b6199 not found: not found"
Expected result:
Running the above command should successfully filter the IDs of containers that are exited
What version of nerdctl are you using?

Description
Version

Nerdctl
v1.7.6

Containerd
v1.7.18

Windows
Build 10.0.22631

Are you using a variant of nerdctl? (e.g., Rancher Desktop)
None
Host information
> nerdctl info
Client:
Namespace:     default
Debug Mode:    false
Server:
Server Version: v1.7.18
Storage Driver: windows
Logging Driver: json-file
Cgroup Driver:
Cgroup Version:
Plugins:
Log: fluentd journald json-file syslog
Storage: windows-lcow windows
Security Options:
Kernel Version:
Operating System:
OSType: windows
Architecture:
CPUs: 0
Total Memory: 0B
Name: Butterfly
ID: 0615135c-53af-410f-98ae-b01bdeb7bae6

This is reminiscent of a race condition between listing all active tasks and inspecting them.
@TinaMor is this always reproducible from a clean environment?

@apostasie It does not repro in a clean environment.

Thanks @TinaMor
i will look into it - though it might take some tlme.
let me know if this is something you hit often.


Relax peer dependency version constraints

MUI 6 is out now, and in my experience it's been mostly backward compatible (I upgraded a medium size codebase with no changes required). What do you think about relaxing the peer dependency version constraints to ">= 5"?

That shouldn't be a problem I think, I have to look into what breaking changes there are between the two

Here's the announcement: https://mui.com/blog/material-ui-v6-is-out/
It doesn't mention any breaking or non-backward-compat changes.


Remove CURLOPT_POSTFIELDS from set of invalid curl options

Right now there is no way to upload a file without loading the entire file into memory twice.
That is quite a bummer, because CURL supports it just fine. The CURLOPT_POSTFIELDS allows doing
just that.
Now it would of course be exellent if the built in file upload stuff in ZF would just use
said option. But as a workaround, it would be great to be able to override it.
Another thing: Getting this to work properly also requires messing around with the ENC_TYPE
in the client. Basically manually overriding it to ENC_FORMDATA.

Requires tests

Igor?

:+1:
@localheinz no, he's just a broken GOTO of @igorw

@Ocramius hahaha :P


Artifact same release version overwrite

Hi, I found that it is possible to deploy multiple times same artifact version in release repo.
It is configurable? I mean, in case of someone tries to deploy artifact with the same version, that is already in the repo, block such requests.

At this moment this moment there is no possibility to block re-deployment, but the solution will be available in Reposilite 3.x. Related issue: #395


AttributeError: 'tensorflow.python.framework.ops.EagerTensor' object has no attribute 'swapaxes'

I am building a CNN model. model compile fine but when i fit the model it does not work: The code fine in my jupyttor but not in kaggle
#metric
def iou_metric_batch(y_true_in, y_pred_in):
    batch_size = y_true_in.shape[0]
    metric = []
    for batch in range(batch_size):
        value = iou_metric(y_true_in[batch], y_pred_in[batch])
        metric.append(value)
    return np.array(np.mean(metric), dtype=np.float32)

def my_iou_metric(label, pred):
    metric_value = tf.py_function(iou_metric_batch, [label, pred], tf.float32)
    return metric_value

model.compile(optimizer='adam', loss='binary_crossentropy', metrics=[my_iou_metric])
tf.compat.v1.disable_eager_execution()
model_path = "nuclei_finder_unet_1.h5"

checkpoint = ModelCheckpoint(model_path,
                             monitor="val_loss",
                             mode="min",
                             save_best_only = True,
                             verbose=1)

earlystop = EarlyStopping(monitor = 'val_loss',
                          min_delta = 0,
                          patience = 5,
                          verbose = 1,
                          restore_best_weights = True)

# Fit our model
results = model.fit(X_train, Y_train, validation_split=0.1,
                    batch_size=16, epochs=10,callbacks=[earlystop, checkpoint])

```Erroe:

nknownError: AttributeError: 'tensorflow.python.framework.ops.EagerTensor' object has no attribute 'swapaxes'
Traceback (most recent call last):
File "/opt/conda/lib/python3.7/site-packages/tensorflow/python/ops/script_ops.py", line 242, in call
stateful=None,
File "/opt/conda/lib/python3.7/site-packages/tensorflow/python/ops/script_ops.py", line 131, in call
"""
File "/opt/conda/lib/python3.7/site-packages/tensorflow/python/autograph/impl/api.py", line 302, in wrapper
File "", line 58, in iou_metric_batch
value = iou_metric(y_true_in[batch], y_pred_in[batch])
File "", line 2, in iou_metric
labels = label(y_true_in > 0.5)
File "/opt/conda/lib/python3.7/site-packages/skimage/measure/_label.py", line 93, in label
return clabel(input, neighbors, background, return_num, connectivity)
File "skimage/measure/_ccomp.pyx", line 348, in skimage.measure._ccomp.label_cython
File "skimage/measure/_ccomp.pyx", line 322, in skimage.measure._ccomp.reshape_array
File "skimage/measure/_ccomp.pyx", line 299, in skimage.measure._ccomp._apply_swaps
AttributeError: 'tensorflow.python.framework.ops.EagerTensor' object has no attribute 'swapaxes'
 [[{{node metrics_10/my_iou_metric/EagerPyFunc}}]]

@NaghmehShahverdi
Please share the tf version used, i ran the code shared and face a different issue.


ASI290MM camera stops after a few hours

OpenCV Error: Incorrect size of input array (Non-positive cols or rows) in cvInitMatHeader, file /build/opencv-U1UwfN/opencv-<IP_ADDRESS>+dfsg1/modules/core/src/array.cpp, line 146
terminate called after throwing an instance of 'cv::Exception'
what():  /build/opencv-U1UwfN/opencv-<IP_ADDRESS>+dfsg1/modules/core/src/array.cpp:146: error: (-201) Non-positive cols or rows in function cvInitMatHeader
/home/pi/allsky/allsky.sh: line 22:   956 Aborted                 ./capture $ARGUMENTS
cd `ftp://username@example.com:/allsky/' [Delaying before reconnect: 121]

Hi,
Does this happen all the time? Is it during a normal night time capture or during timelapse generation?
Can you paste your configuration here?
Also, Can you set UPLOAD_IMG to false in config.sh? That will prevent the upload attempts.
Thanks

`pi@allsky:~/allsky $ more config.sh
#!/bin/bash
source /home/pi/allsky/scripts/ftp-settings.sh
Set to true to upload current image to your website
UPLOAD_IMG=false
Set to true to upload timelapse video to your website at the end of each night
UPLOAD_VIDEO=false
Set to true to send data to your server at the end of each night
POST_END_OF_NIGHT_DATA=false
Set to true to generate a timelapse at the end of the night
TIMELAPSE=true
Set to true to generate a keogram at the end of the night (image summary of th
e night)
KEOGRAM=true
Set to true to upload the keogram after it has been generated
UPLOAD_KEOGRAM=false
Set to true to generate a startrails image of the night. Will skip brighter im
ages to avoid over-exposure
STARTRAILS=true
Set to true to upload the startrails after it has been generated
UPLOAD_STARTRAILS=false
Set to true to enable automatic deletion of archived data (images + videos)
AUTO_DELETE=true
Set this value to the number of archived nights you want to keep. Needs AUTO_D
ELETE=true to work
NIGHTS_TO_KEEP=14
Path to the dark frame for hot pixels subtraction. Can be jpg or png.
DARK_FRAME="dark.png"
Set to 1 to enable Daytime Capture
DAYTIME="0"
Path to the camera settings (exposure, gain, delay, overlay, etc)
CAMERA_SETTINGS="/home/pi/allsky/settings.json"
pi@allsky:~/allsky $
`

That looks fine to me. Can you show me what you have for settings.json?

Yes!  Thanks for the help!
pi@allsky:~/allsky $ cat settings.json
{
   "width":"0",
   "height":"0",
   "exposure":"10000",
   "maxexposure":"10000",
   "autoexposure":"0",
   "gain":"0",
   "maxgain":"400",
   "autogain":"1",
   "gain":"50",
   "gamma":"50",
   "brightness":"50",
   "wbr":"53",
   "wbb":"90",
   "bin":"2",
   "delay":"10",
   "daytimeDelay": "5000",
   "type":"1",
   "quality":"95",
   "usb":"40",
   "filename":"image.jpg",
   "flip":"0",
   "text":"text",
   "textx":"15",
   "texty":"35",
   "fontname":"0",
   "fontcolor":"255 255 255",
   "fonttype":"0",
   "fontsize":"0.7",
   "fontline":"1",
   "latitude":"35.5N",
   "longitude":"78.5W",
   "time":"1",
   "darkframe":"0"
}
pi@allsky:~/allsky $

Also it seems to only take one photo now and stop?!
pi@allsky:~/allsky $ sudo service allsky status
* allsky.service - All Sky Camera
   Loaded: loaded (/lib/systemd/system/allsky.service; enabled; vendor preset: e
   Active: active (running) since Tue 2018-07-31 21:59:55 EDT; 4min 18s ago
 Main PID: 771 (allsky.sh)
   CGroup: /system.slice/allsky.service
           |-771 /bin/bash /home/pi/allsky/allsky.sh
           `-851 ./capture -autoexposure 0 -autogain 1 -bin 2 -brightness 50 -da

Jul 31 21:59:55 allsky systemd[1]: Started All Sky Camera.
pi@allsky:~/allsky $ ls images/20180731/
image-20180731215529.jpg  image-20180731220051.jpg
image-20180731215740.jpg  thumbnails
pi@allsky:~/allsky $ ls images/20180731/
image-20180731215529.jpg  image-20180731220051.jpg
image-20180731215740.jpg  thumbnails
pi@allsky:~/allsky $ sudo service allsky status
* allsky.service - All Sky Camera
   Loaded: loaded (/lib/systemd/system/allsky.service; enabled; vendor preset: e
   Active: active (running) since Tue 2018-07-31 21:59:55 EDT; 4min 46s ago
 Main PID: 771 (allsky.sh)
   CGroup: /system.slice/allsky.service
           |-771 /bin/bash /home/pi/allsky/allsky.sh
           `-851 ./capture -autoexposure 0 -autogain 1 -bin 2 -brightness 50 -da

Jul 31 21:59:55 allsky systemd[1]: Started All Sky Camera.
pi@allsky:~/allsky $ ls images/20180731/
image-20180731215529.jpg  image-20180731220051.jpg
image-20180731215740.jpg  thumbnails
pi@allsky:~/allsky $

Also I swapped the 290 for a 174MM

also, can I make a feature request?  Last 1min video loop?!  That's be great to spot really high, thin clouds.

Was it dark when you tried the capture?
The way it works is that it will only take images from dusk to dawn based on your GPS coordinates. You can change them to see if it starts saving new images correctly.

It was dark but fooling around I got it to take some photos but only when I stop start it...  also, why is this image from this AM in last night's folder?
Name↓ | Last Modified: | Size: | Type:
-- | -- | -- | --
../ |   | - | Directory
thumbnails/ | 2018-Aug-01 10:34:08 | - | Directory
image-20180731215529.jpg | 2018-Jul-31 21:55:29 | 267.6K | image/jpeg
image-20180731215740.jpg | 2018-Jul-31 21:57:40 | 109.5K | image/jpeg
image-20180731220051.jpg | 2018-Jul-31 22:00:51 | 110.0K | image/jpeg
image-20180731220836.jpg | 2018-Jul-31 22:08:36 | 104.6K | image/jpeg
image-20180731220904.jpg | 2018-Jul-31 22:09:04 | 106.2K | image/jpeg
image-20180731221006.jpg | 2018-Jul-31 22:10:06 | 106.2K | image/jpeg
image-20180731221328.jpg | 2018-Jul-31 22:13:28 | 101.9K | image/jpeg
image-20180731221651.jpg | 2018-Jul-31 22:16:51 | 9.6K | image/jpeg
image-20180731221817.jpg | 2018-Jul-31 22:18:17 | 99.9K | image/jpeg
image-20180731221842.jpg | 2018-Jul-31 22:18:42 | 101.9K | image/jpeg
image-20180731221907.jpg | 2018-Jul-31 22:19:07 | 108.6K | image/jpeg
image-20180731222324.jpg | 2018-Jul-31 22:23:24 | 155.7K | image/jpeg
image-20180731222404.jpg | 2018-Jul-31 22:24:04 | 154.5K | image/jpeg
image-20180731222453.jpg | 2018-Jul-31 22:24:53 | 107.3K | image/jpeg
image-20180731222547.jpg | 2018-Jul-31 22:25:47 | 90.9K | image/jpeg
image-20180731222718.jpg | 2018-Jul-31 22:27:18 | 12.0K | image/jpeg
image-20180731222728.jpg | 2018-Jul-31 22:27:28 | 12.1K | image/jpeg
image-20180731222735.jpg | 2018-Jul-31 22:27:35 | 12.1K | image/jpeg
image-20180731222745.jpg | 2018-Jul-31 22:27:45 | 12.0K | image/jpeg
image-20180731222840.jpg | 2018-Jul-31 22:28:40 | 90.1K | image/jpeg
image-20180731222911.jpg | 2018-Jul-31 22:29:11 | 89.5K | image/jpeg
image-20180731223215.jpg | 2018-Jul-31 22:32:15 | 155.4K | image/jpeg
image-20180731223433.jpg | 2018-Jul-31 22:34:33 | 153.4K | image/jpeg
image-20180731224748.jpg | 2018-Jul-31 22:47:48 | 151.5K | image/jpeg
image-20180731230138.jpg | 2018-Jul-31 23:01:38 | 161.8K | image/jpeg
image-20180731230322.jpg | 2018-Jul-31 23:03:22 | 159.9K | image/jpeg
image-20180731230706.jpg | 2018-Jul-31 23:07:06 | 121.4K | image/jpeg
image-20180801103407.jpg | 2018-Aug-01 10:34:07 | 184.9K | image/jpeg

Current settings file....

pi@allsky:~/allsky $ cat settings.json
{
   "width":"0",
   "height":"0",
   "exposure":"9000",
   "maxexposure":"9000",
   "autoexposure":"0",
   "gain":"150",
   "maxgain":"400",
   "autogain":"1",
   "gain":"150",
   "gamma":"50",
   "brightness":"50",
   "wbr":"53",
   "wbb":"90",
   "bin":"2",
   "delay":"10",
   "daytimeDelay": "5000",
   "type":"1",
   "quality":"95",
   "usb":"40",
   "filename":"image.jpg",
   "flip":"0",
   "text":"text",
   "textx":"15",
   "texty":"35",
   "fontname":"0",
   "fontcolor":"255 255 255",
   "fonttype":"0",
   "fontsize":"0.7",
   "fontline":"1",
   "latitude":"35.5N",
   "longitude":"78.5W",
   "time":"1",
   "darkframe":"0"
}

It seems to be working now, could it have to wait a whole day/night cycle before working?

Found it!

root@allsky:/home/pi/allsky# cat /var/log/allsky.log
Aug  1 21:34:06 allsky allsky.sh[14042]: convert-im6.q16: insufficient image data in file `image.jpg' @ error/jpeg.c/ReadJPEGImage/1039.
Aug  1 21:34:06 allsky allsky.sh[14042]: convert-im6.q16: no images defined `images/20180801/thumbnails/image-20180801213404.jpg' @ error/convert.c/ConvertImageCommand/3258.
Aug  1 21:34:06 allsky allsky.sh[14042]: /home/pi/allsky/allsky.sh: line 25: 14081 Segmentation fault      ./capture $ARGUMENTS
root@allsky:/home/pi/allsky#

Ok, thanks for tracking that down. Thumbnails generation is a new feature and it seems to fail when the source is empty or incomplete. I'll take a look at it. It should be fairly easy to fix.
Regarding your image showing in yesterday's directory, this is normal. The way directories are organised is the following: Make a new directory for any image taken after noon (12:00pm) and keep putting images in there until noon next day. This is considered a "Night".

Sweet!  Once I'm done I'll have you add me to your maps and "I made this".  Would you consider having another section of the gui that gave a 'last X-minute' animation?  basically just take the last 60s and make a movie that overwrites itself to give a view of the high clouds I seem to have all too often


Make it possible to switch between local and remote inventories using the CLI

See #59. The feature can be enabled by modifying the Escape config, but it would be nice if we had a command and user flow for it.

For #61 we enabled the local inventory by default, but also started proxying some namespaces to escape.ankyra.io by default. We need to update the "escape login" command to be able to modify these settings, and we also need an equivalent command for local inventories. Might require some reordering altogether.


Doesn't work on OSX 10.9 (Mavericks)

Hello,
Looks like create-dmg doesn't work on Mavericks. Even Mavericks is like 5 years old OS, but there are some people who still using it.
http://gs.statcounter.com/macos-version-market-share/desktop/worldwide
One guy wasn't able to open dmg image on Mavericks 10.9.4
He sent me the following screenshot:

I will be very grateful if you can fix it.

This is already documented in the readme:

The DMG requires macOS 10.11 or later

Thanks for the info @sindresorhus
Will changing ULFO to UBDZ will support Mavericks?
Like you mentioned in similar Yosemite issue
https://github.com/sindresorhus/create-dmg/issues/11#issuecomment-301828156

Yes

Thanks @sindresorhus Appreciate your help.
Just tested both formats on Sierra. Comparing to ULFO, UDBZ is slower than dial-up :)

Don't get why is it closed. As see in sources, format: 'ULFO' but according to man hdiutil it supported by only 10.11+, what is the reason?
                      UDCO - UDIF ADC-compressed image
                      UDZO - UDIF zlib-compressed image
                      ULFO - UDIF lzfse-compressed image (OS X 10.11+ only)
                      UDBZ - UDIF bzip2-compressed image (Mac OS X 10.4+ only)


Bot crashes after editing a message

As shown in the above image the bot crashes after the user edits a previously sent message.

@rifhanakram Thanks for the info, mate. Can you give us more details about this?

[ ] have you signed in using your domain username?
[ ] did you try this running locally?
[ ] or used the production version?
[ ] have you tried this again, recently, say yesterday?

Hi @kosalanuwan thank you for the response. sorry for the delayed response on my side.

[√ ] have you signed in using your domain username?
[x ] did you try this running locally?
[ √] or used the production version?
[√] have you tried this again, recently, say yesterday?

I tried it just now and the edit works fine. the only bug now is that the message is not what is intended instead is in xml format.

and one other issue i noticed is it doesn't recognize only minutes. taking the above screen shot as an example i first tried logging time with 15m it then couldn't recognize it i then tried 0.25h then it worked fine.


Roll Engine from 88a8e9db1806 to 08bc5ff63f00 (2 revisions)

https://github.com/flutter/engine/compare/88a8e9db1806...08bc5ff63f00
2020-07-01<EMAIL_ADDRESS>Roll Skia from 16ee98ddeda3 to e381036051eb (2 revisions) (flutter/engine#19448)
2020-07-01<EMAIL_ADDRESS>Roll Dart SDK from bec128612c03 to 63feed82e1b1 (8 revisions) (flutter/engine#19447)
If this roll has caused a breakage, revert this CL and stop the roller
using the controls here:
https://autoroll.skia.org/r/flutter-engine-flutter-autoroll
Please CC<EMAIL_ADDRESS>on the revert to ensure that a human
is aware of the problem.
To report a problem with the AutoRoller itself, please file a bug:
https://bugs.chromium.org/p/skia/issues/entry?template=Autoroller+Bug
Documentation for the AutoRoller is here:
https://skia.googlesource.com/buildbot/+doc/master/autoroll/README.md

Commit queue failed; closing this roll.


500 Internal Server Error deploying Azure VM Image Builder DevOps Task (Preview)

When trying to deploy the Image Builder task from the DevOps marketplace I'm met with a 500 internal server error.
I'm using this link that I found in the official docs.
https://marketplace.visualstudio.com/items?itemName=AzureImageBuilder.devOps-task-for-azure-image-builder

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 021a6939-d8c6-29ea-2194-770c5d5cd39a
Version Independent ID: e0d48667-9d39-3af3-b821-b1b8c788ef57
Content: Azure Image Builder Service DevOps Task - Azure Virtual Machines
Content Source: articles/virtual-machines/linux/image-builder-devops-task.md
Service: virtual-machines
Sub-service: image-builder
GitHub Login: @danielsollondon
Microsoft Alias: danis

@henrikhelvete Is there a specific doc that you are referring to here?
Do note that this repo is primarily for addressing doc related feedback. For other queries, Microsoft Q&A is a better place to engage the wider community.

@henrikhelvete Just following up here to see if you could share the doc that you are referring to here.

My bad, I'm new to this. I'm not sure how I ended up here. I just followed the workflow I was presented with from az devops trying to get a comment on this. I was following "stable task" link from here: https://docs.microsoft.com/en-us/azure/virtual-machines/linux/image-builder-devops-task

Hi @henrikhelvete - Apologies for this, we will run a documentation check, however without knowing your exact inputs (image source, customizations, distribution) it will be best effort check. I don't want you to wait on us checking the docs, in parallel please can you raise a case that has your details (such as subcriptionID) and we can also check out the backend telemetry too.

@danielsollondon Thanks for your advise, I will follow up on this seeing as the 500 remains even as of today.

@henrikhelvete a support request is definitely your best option here. If you do not have a support plan, please let me know!
I am closing this issue as it is being pursued further with support.
We will now proceed to close this thread. If there are further questions regarding this matter, please tag me in your reply. We will gladly continue the discussion and we will reopen the issue.


Encryption of exported addressbook

Would you want the exported address book to be encrypted? If so, the importAddressBook() method in XmlAddressBookStorage class would require a line SecurityUtil.decrypt(file) to be added before the target file is loaded.

#89

#92


python311Packages.pydash: 5.1.1 -> 7.0.6

Diff: https://github.com/dgilland/pydash/compare/refs/tags/v5.1.1...v7.0.6
Changelog: https://github.com/dgilland/pydash/blob/v7.0.6/CHANGELOG.rst
Description of changes
Fix build (https://hydra.nixos.org/build/246566920)

Things done

Built on platform(s)

[ ] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
24.05 Release Notes (or backporting 23.05 and 23.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[ ] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

Result of nixpkgs-review pr 281357 run on x86_64-linux 1

6 packages marked as broken and skipped:

cfripper
cfripper.dist
python312Packages.pydash
python312Packages.pydash.dist
python312Packages.sphinx-markdown-parser
python312Packages.sphinx-markdown-parser.dist

2 packages failed to build:

python311Packages.sphinx-markdown-parser
python311Packages.sphinx-markdown-parser.dist

4 packages built:

python311Packages.okta
python311Packages.okta.dist
python311Packages.pydash
python311Packages.pydash.dist

Result of nixpkgs-review pr 281357 run on x86_64-linux 1

4 packages failed to build:

cfripper
cfripper.dist
python312Packages.sphinx-markdown-parser
python312Packages.sphinx-markdown-parser.dist

8 packages built:

python311Packages.okta
python311Packages.okta.dist
python311Packages.pydash
python311Packages.pydash.dist
python311Packages.sphinx-markdown-parser
python311Packages.sphinx-markdown-parser.dist
python312Packages.pydash
python312Packages.pydash.dist

Result of nixpkgs-review pr 281357 run on x86_64-linux 1

2 packages failed to build:

cfripper
cfripper.dist

14 packages built:

python311Packages.okta
python311Packages.okta.dist
python311Packages.pydash
python311Packages.pydash.dist
python311Packages.sphinx-markdown-parser
python311Packages.sphinx-markdown-parser.dist
unify (python311Packages.unify)
unify.dist (python311Packages.unify.dist)
python312Packages.pydash
python312Packages.pydash.dist
python312Packages.sphinx-markdown-parser
python312Packages.sphinx-markdown-parser.dist
python312Packages.unify
python312Packages.unify.dist

cfripper fails because of pycfmodel's missing support for pydantic> 2.


Upload version 2.6.0 to Confluent Hub

The latest FilePulse version on Confluent Hub 2.4.3, are there plans to host the most recent version on there?

@kurtis-ley I think you can download version 2.6 from the releases page.

Hi @kurtis-ley, FilePulse 2.7.0 has been released. I hope it will be available soon on ConfluentHub.


Tensorflow 2 - oneDNN 1.x build fails searching for i_malloc.h, mkl_cblas.h on non-x86 machines.

Please make sure that this is a build/installation issue. As per our GitHub Policy, we only address code/doc bugs, performance issues, feature requests and build/installation issues on GitHub. tag:build_template
System information

OS Platform and Distribution (e.g., Linux Ubuntu 16.04):
NAME="CentOS Linux"
VERSION="8 (Core)"

Mobile device (e.g. iPhone 8, Pixel 2, Samsung Galaxy) if the issue happens on mobile device: No

TensorFlow installed from (source or binary): source

TensorFlow version: master & 2.2.0

Python version: 3.6.8

Installed using virtualenv? pip? conda?: virtualenv

Bazel version (if compiling from source): 3.1.0

GCC/Compiler version (if compiling from source): GCC 8.3.1

CUDA/cuDNN version: N/A

GPU model and memory: N/A

Describe the problem
I am building Tensorflow with oneDNN 1.4.0 on an Aarch64 machine, which causes issues when searching for MKL-ML header files (e.g. i_malloc.h).
Example log 1:
/home/../tensorflow-nb/packages/tensorflow/tensorflow/core/common_runtime/BUILD:1018:1: C++ compilation of rule '//tensorflow/core/common_runtime:mkl_cpu_allocator' failed (Exit 1)
In file included from tensorflow/core/common_runtime/mkl_cpu_allocator.cc:18:
./tensorflow/core/common_runtime/mkl_cpu_allocator.h:33:10: fatal error: i_malloc.h: No such file or directory
 #include "i_malloc.h"
 ^~~~~~~~~~~~
compilation terminated.

Example log 2:
ERROR: /home/.../tensorflow-nb/packages/tensorflow/tensorflow/core/kernels/BUILD:4109:1: C++ compilation of rule '//tensorflow/core/kernels:mkl_batch_matmul_op' failed (Exit 1)
tensorflow/core/kernels/mkl_batch_matmul_op.cc:31:10: fatal error: mkl_cblas.h: No such file or directory
 #include "mkl_cblas.h"
          ^~~~~~~~~~~~~
compilation terminated.
Target //tensorflow/tools/pip_package:build_pip_package failed to build
ERROR: /home/.../tensorflow-nb/packages/tensorflow/tensorflow/lite/toco/python/BUILD:84:1 C++ compilation of rule '//tensorflow/core/kernels:mkl_batch_matmul_op' failed (Exit 1)

In previous Tensorflow versions  (1.x), for example, when building with the older mkldnn library 0.21.x, these header files were removed with mkldnn ifdefs (INTEL_MKL_DNN_ONLY):
https://github.com/tensorflow/tensorflow/blob/590d6eef7e91a6a7392c8ffffb7b58f2e0c8bc6b/tensorflow/core/common_runtime/mkl_cpu_allocator.h#L32
while these ifdefs are not activated when building with the new oneDNN 1.x (with for e.g -DENABLE_MKLDNN_V1)
There are several sources that have this issue (this is from a successful x86 build):
./tensorflow/core/kernels/_objs/mkl_transpose_op/mkl_transpose_op.pic.d:3: external/mkl_linux/include/mkl_trans.h \
./tensorflow/core/kernels/_objs/mkl_transpose_op/mkl_transpose_op.pic.d:5: external/mkl_linux/include/mkl_types.h \
./tensorflow/core/kernels/_objs/mkl_batch_matmul_op/mkl_batch_matmul_op.pic.d:51: external/mkl_linux/include/mkl_cblas.h \
./tensorflow/core/kernels/_objs/mkl_batch_matmul_op/mkl_batch_matmul_op.pic.d:52: external/mkl_linux/include/mkl_types.h \
./tensorflow/core/common_runtime/_objs/mkl_cpu_allocator/mkl_cpu_allocator.pic.d:623: external/mkl_linux/include/i_malloc.h
./tensorflow/core/common_runtime/_objs/threadpool_device/threadpool_device.pic.d:718: tensorflow/core/lib/core/bits.h external/mkl_linux/include/i_malloc.h \

Provide the exact sequence of commands / steps that you executed before running into the problem
bazel build --config=v2 --config=mkl  \
    --copt="-mtune=native" --copt="-march=armv8-a" --copt="-O3" --copt="-fopenmp" \
    --cxxopt="-mtune=native" --cxxopt="-march=armv8-a" --cxxopt="-O3" --cxxopt="-fopenmp" \
    --linkopt="-lm" --linkopt="-fopenmp" \
    --config=noaws  --cxxopt="-D_GLIBCXX_USE_CXX11_ABI=0" \
    //tensorflow/tools/pip_package:build_pip_package

Any other info / logs
Include any logs or source code that would be helpful to diagnose the problem. If including tracebacks, please include the full traceback. Large logs and files should be attached.

Adding @nSircombe  for support of oneDNN on ARM.

Thanks for the heads-up @agramesh1, as it happens I'm actually working with @cfRod!
At the moment, oneDNN v1.4+ builds on AArch64 'out of the box' and we've been able to build TensorFlow with oneDNN v0.20.x. But, as @cfRod details, we have some problems with building TensorFlow with oneDNN v1.x. - these don't appear to be an issue with oneDNN. It looks as if there are two issues which balance each other out in the case of an x86 build:

the ifdefs for a v1.x build appear to re-include headers omitted from v0.x builds.
TensorFlow downloads an MKL-ML tarball (https://github.com/intel/mkl-dnn/releases/download/v0.21/mklml_lnx_2<IP_ADDRESS>90502.tgz) which includes those headers (as well as an MKL-ML binary). This doesn't appears (now) to be necessary, and possibly unintentional?
This download does not happen for an AArch64 build, hence the missing header files.

@nSircombe yes, for MKL DNN 0.2.x version had defines that will allow you to compile with only opensource components.
With the move to oneDNN 1.4x in TF2.2 that broke and we haven't fixed it as yet.  You should be able to remove all references of mkl in the allocator code to get it compile. We are working on cleaning up the code and remove the blob dependencies when compiled with oneDNN 1.4.

Submitted PR: https://github.com/tensorflow/tensorflow/pull/41232

Submitted PR: #41232

@cfRod Thanks, I will review the code.


Undefined symbols for architecture arm64

Repro steps:

rbenv install 3.2.2

Expected: Should install
Result:
(base) MacBook-Pro-2:~ thomasuster$ rbenv install 3.2.2
To follow progress, use 'tail -f /var/folders/9d/vrcyr_mj18z4fw0tgqqs__dc0000gn/T/ruby-build.20230919153117.40397.log' or pass --verbose
Downloading openssl-3.1.2.tar.gz...
-> https://dqw8nmjcqpjn7.cloudfront.net/a0ce69b8b97ea6a35b96875235aa453b966ba3cba8af2de23657d8b6767d6539
Installing openssl-3.1.2...
Installed openssl-3.1.2 to /Users/thomasuster/.rbenv/versions/3.2.2

Downloading ruby-3.2.2.tar.gz...
-> https://cache.ruby-lang.org/pub/ruby/3.2/ruby-3.2.2.tar.gz
Installing ruby-3.2.2...
ruby-build: using readline from homebrew
ruby-build: using libyaml from homebrew

BUILD FAILED (macOS 13.5.2 using ruby-build 20230919)

Inspect or clean up the working tree at /var/folders/9d/vrcyr_mj18z4fw0tgqqs__dc0000gn/T/ruby-build.20230919153117.40397.4Dhb9j
Results logged to /var/folders/9d/vrcyr_mj18z4fw0tgqqs__dc0000gn/T/ruby-build.20230919153117.40397.log

Last 10 log lines:
make[1]: Nothing to be done for `srcs'.
generating transdb.h
transdb.h updated
linking miniruby
Undefined symbols for architecture arm64:
  "_coroutine_transfer", referenced from:
      _fiber_setcontext in cont.o
ld: symbol(s) not found for architecture arm64
clang: error: linker command failed with exit code 1 (use -v to see invocation)
make: *** [miniruby] Error 1

Chip: Apple M1 Max
macOS: 13.5.2
Notes:

This happens on any ruby version I try to install past 2.7.8.
Repro'd on Ventura 13.5.1 & 13.5.2
A couple of searched on this issue point to similar
These similar looking from 2021 & 2022 recommend upgrading binutils. When I do this and add binutils to path I get other strange errors.

To follow progress, use 'tail -f /var/folders/9d/vrcyr_mj18z4fw0tgqqs__dc0000gn/T/ruby-build.20230919154130.35418.log' or pass --verbose
Downloading openssl-3.1.2.tar.gz...
-> https://dqw8nmjcqpjn7.cloudfront.net/a0ce69b8b97ea6a35b96875235aa453b966ba3cba8af2de23657d8b6767d6539
Installing openssl-3.1.2...

BUILD FAILED (macOS 13.5.2 using ruby-build 20230919)

Inspect or clean up the working tree at /var/folders/9d/vrcyr_mj18z4fw0tgqqs__dc0000gn/T/ruby-build.20230919154130.35418.DmGplc
Results logged to /var/folders/9d/vrcyr_mj18z4fw0tgqqs__dc0000gn/T/ruby-build.20230919154130.35418.log

Last 10 log lines:
  "_test_ptr", referenced from:
      _test_x509_files in algorithmid_test-bin-algorithmid_test.o
      _test_spki_aid in algorithmid_test-bin-algorithmid_test.o
  "_test_true", referenced from:
      _test_x509_files in algorithmid_test-bin-algorithmid_test.o
      _test_spki_aid in algorithmid_test-bin-algorithmid_test.o
ld: symbol(s) not found for architecture arm64
clang: error: linker command failed with exit code 1 (use -v to see invocation)
make[1]: *** [test/algorithmid_test] Error 1
make: *** [build_sw] Error 2

These types of installation failures are almost always due to one or more of these:

a broken development setup
installing things using both arm64 and Rosetta or arch -x86_64
missing or misconfigured or outdated tools
setting Ruby compilation settings globally in your shell file

The best way to fix this is to start over with a clean slate. If you want to try small fixes first, you could go through your shell files (such as .zprofile, .zshrc, .zlogin) and remove anything that could affect Ruby installation. I would also run brew doctor and see if it complains about anything.
If you don't have time to try to fix everything, and if you're willing to pay for a solution that will have you back up and running in 15 minutes, I built a paid product that can safely back up your dev setup, then clean it up in 1 minute. And then it will reinstall a proper and complete Ruby dev environment for you. I launched it almost 2 years ago, and I have over 1700 happy customers so far.
Check it out: https://www.rubyonmac.dev/

@thomasuster On top of what @monfresh already said, binutils from Homebrew should not be necessary for compiling Ruby. If you had them linked to PATH for some reason, unlink them with brew unlink binutils.
The compilation failure seems to be in the openssl compilation phase. It could be useful to install OpenSSL via Homebrew and link to that instead of having ruby-build compile openssl every time:
brew install<EMAIL_ADDRESS>RUBY_CONFIGURE_OPTS="--with-openssl-dir=$(brew --prefix openssl@3.0)" rbenv install 3.2.2

See https://github.com/rbenv/ruby-build/wiki
Finally, this issue belongs to the ruby-build repo and not to rbenv proper. Transferring


HTML to Commonmark

Is there an option to convert HTML to Commonmark? I.e given a string with HTML in it, convert it to Commonmark?

No. That's a reverse task, out of this project scope. Try to search in google, there should be some ready packages, but i don't remember details.


Failed to create bus connection

Host OS is OSX, running Docker for OSX.
$ sw_vers
ProductName:	Mac OS X
ProductVersion:	10.12.6
BuildVersion:	16G1212

$ docker --version
Docker version 17.12.0-ce, build c97c6d6

If I run the command from your example
docker run -d --name systemd --security-opt seccomp=unconfined --tmpfs /run --tmpfs /run/lock -v /sys/fs/cgroup:/sys/fs/cgroup:ro -t solita/ubuntu-systemd

Then
docker exec -it systemd /bin/sh
# timedatectl status
Failed to create bus connection: No such file or directory

The same scenario works fine with a centos image running systemd.
Thanks in advance for your help with this.
Damian.

Hi Damian,
Unfortunately I don't have any ideas about what could be causing that error. I don't use this image anymore, but if you find a way to fix the problem, I'd be happy to merge the fix and credit you as a contributor.

@noidi looks like dbus is missing from the base image.
apt-get install dbus

works fine.
# timedatectl status
      Local time: Mon 2018-02-26 13:25:10 UTC
  Universal time: Mon 2018-02-26 13:25:10 UTC
        RTC time: n/a
       Time zone: n/a (UTC, +0000)
 Network time on: no
 NTP synchronized: no
 RTC in local TZ: no

Not sure if you should add it or not, up to yourself, if not maybe a comment in the README?
Thanks,
Damian.

@noidi fyi, I came to your image through molecule your base is provided as an example for ubuntu with systemd in containers.  See here http://molecule.readthedocs.io/en/latest/examples.html

Thanks for debugging the issue and mentioning Molecule, I had not heard of it before.
I guess adding dbus would make sense given the virtual-machine-ish nature of the image.

Agreed, if you can do that it will add a small amount of space, but make image more useful.  On our side we wont have to inherit and build our own.

Thanks for your answer, it works fo me in ubt16.04.


openvpn: 2.4.7 -> 2.4.9

Motivation for this change

https://github.com/OpenVPN/openvpn/blob/release/2.4/Changes.rst#version-249
https://nvd.nist.gov/vuln/detail/CVE-2020-11810

Things done

[x] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[x] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[x] Fits CONTRIBUTING.md.

@GrahamcOfBorg eval

@GrahamcOfBorg eval

Result of nixpkgs-review pr 85858 1

13 packages built:
- connman
- connman-gtk
- connman-ncurses
- connmanFull
- connman_dmenu
- connmanui
- deepin.dde-control-center
- networkmanager-openvpn (gnome3.networkmanager-openvpn ,networkmanager_openvpn)
- openvpn
- openvpn-auth-ldap
- plasma-nm
- protonvpn-cli
- protonvpn-cli-ng


Refreshing token does not throw error when server returns 401

I'm attempting to write try and catch blocks for error handling when refreshing access token.  When the OAuth2 server responded with a 401 error code (invalid refresh token), the script threw a unexpected exception.  Debug log shows:
[2019-05-13 12:10:29] console.ERROR: Error thrown while running command "app:capi-refresh-token". Message: "Required option not passed: "access_token"" {"exception":"[object] (InvalidArgumentException(code: 0): Required option not passed: \"access_token\" at /var/projects/sites/edscc/vendor/league/oauth2-client/src/Token/AccessToken.php:62)","command":"app:capi-refresh-token","message":"Required option not passed: \"access_token\""} []

Here's the code snippet:
$grant = new RefreshToken();
                try {
                    $newAccessToken = $this->OAuth2Helper->getAccessToken($grant, [
                        'refresh_token' => $oauth2->getRefreshToken(),
                        'type' => 'refresh'
                    ]);
                    $this->OAuth2Helper->saveAccessTokenToDataStore($item->getUser(), $newAccessToken);
                    $count++;
                }
                catch (IdentityProviderException $e) {
                    $this->errorLogHelper->addErrorMsgToErrorLog('CapiRefreshAuth', $e->getCode(), $e);
                    $oauth2 = $item->getUser()->getOauth2();
                    $oauth2->setRefreshFailed(true);
                    $failed++;
                }

The script stops at $this->OAuth2Helper->getAccessToken() and does not go any further. I don't understand why my try/catch block didn't capture the exception but instead your library threw an error and stopped there.  Is there a way I can handle this gracefully?
TIA,
Josh

Your try/catch isn't catching it because the exception is InvalidArgumentException and not IdentityProviderException.
It looks like this is because we always require the access_token parameter:
https://github.com/thephpleague/oauth2-client/blob/badb01e62383430706433191b82506b6df24ad98/src/Token/AccessToken.php#L86-L99
If you add access_token to the array you're passing to getAccessToken(), then it should work.
RFC 6749, section 6 doesn't list access_token as a required parameter for refreshing a token, but I think we required it in the base oauth2-client library because, at the time, most providers required it. If you do not want to pass it, you could implement a custom provider with a custom access token object.
If you choose to create a custom provider, start here: https://github.com/thephpleague/oauth2-client/blob/master/README.PROVIDER-GUIDE.md


Do we have option to turn on/off this feature?

Dear Elkan Roelen,
Do we have an option to turn on/off the report in behat.yml file ?
Sometime, I would like to turn off and check issue from command line.
Thank you so much for great extension.

Hi,
You can have both a the html report and the command line report. Just add the node "pretty" in your behat.yml file, just like that:
  formatters:
    pretty: ~
    html:
      output_path: %paths.base%/...

When you don't configure any formatter, behat will use "pretty" by default. It's the one that prints the report in the CLI.

Hi,
That would be great.
Thank you so much for your response and perfectly extension as well.
On Tue, Mar 13, 2018 at 11:14 PM, Florian-Merle<EMAIL_ADDRESS>wrote:

Hi,
You can have both a the html report and the command line report. Just add
the node "pretty" in your behat.yml file, just like that:
formatters:
pretty: ~
html:
output_path: %paths.base%/...
When you don't configure any formatter, behat will use "pretty" by
default. It's the one that prints the report in the CLI.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/ElkanRoelen/behatformatter/issues/8#issuecomment-372723385,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AgYBwY_uRpaSi2OZ9r_reypmLTdjZGwHks5td_BQgaJpZM4QpZAA
.


Add renovate

need to do the rest of the steps from the issue but should fix #153. Happy for someone else to pick up

Attempting to install Renovate into the PIXL repo (as per https://github.com/apps/renovate ) I get the error This action must be performed by an organization owner.
Oddly, the app already appears to be installed (See https://github.com/UCLH-Foundry/PIXL/settings/installations ) although I don't have permission to configure it. But if it's already been installed there should be an "Onboarding PR" that it automatically generates (see https://github.com/renovatebot/tutorial?tab=readme-ov-file#part-2---onboarding ) which doesn't exist. So I don't know what has happened here.

Without being an admin of that repo it is hard to tell but yes you need to install the app for that specific repo. Easiest way to double check is go to https://developer.mend.io/github/UCLH-Foundry and check it is listed, i.e.

Thanks. Yes, it's listed. The job logs suggest it's in dry run mode though. Perhaps because it's pointing at main and the renovate config file is only in a different branch? The tutorial doesn't say anything about dry runs. Maybe this is in the settings I can't access?
INFO: Repository started
{
  "renovateVersion": "37.368.10"
}

INFO: DRY-RUN: Would commit files to onboarding branch
INFO: Dependency extraction complete
{
  "baseBranch": "main"
  "stats": {
    "managers": {
      "docker-compose": {
        "fileCount": 5,
        "depCount": 7
      },
      "dockerfile": {
        "fileCount": 6,
        "depCount": 6
      },
      "github-actions": {
        "fileCount": 1,
        "depCount": 12
      },
      "pep621": {
        "fileCount": 7,
        "depCount": 101
      }
    },
    "total": {
      "fileCount": 19,
      "depCount": 126
    }
  }
}

INFO: Repository finished
{
  "cloned": true
  "durationMs": 32106
}

There needs to be some kind of @renovatebot config in the main branch. It should have made an onboarding PR - which would be automatically closed if you were to merge a config file in beforehand.

🚀 ❤

schedule:monthly is already set https://github.com/UCL-ARC/.github/blob/79d60db13e5b9c09843626dd242a4e69d2d056ec/renovate/default-config.json#L6


Webgl viewer

Motivation and Context
WebGL build of habitat-sim. Currently only the viewer is supported.
How Has This Been Tested

Download and install emscripten SDK from https://emscripten.org/
Make sure to source emscripten env variables before building (i.e. source ~/code/emsdk/emsdk_env.sh or similar)
Run ./build_js.sh
Follow instructions at end of build to launch server and open viewer in browser tab

Types of changes

[ ] Docs change / refactoring / dependency upgrade
[ ] Bug fix (non-breaking change which fixes an issue)
[X] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)

Checklist

[X] My code follows the code style of this project.
[ ] My change requires a change to the documentation.
[ ] I have updated the documentation accordingly.
[X] I have read the CONTRIBUTING document.
[X] I have completed my CLA (see CONTRIBUTING)
[ ] I have added tests to cover my changes.
[ ] All new and existing tests passed.

One thing I forgot -- this happened recently: https://blog.magnum.graphics/announcements/new-emscripten-application-implementation/
I'm not saying this PR should switch to it ("don't fix what's not broken") but I'd suggest keeping this possibility in mind and switching to it later, as the new implementation is superior to Sdl2Application in every way.

It seems that CI complains that tinyobj is not cleanly removed and building with setup.py is failing. I was able to build after running git rm --cached src/deps/tinyobjloader/

It seems that CI complains that tinyobj is not cleanly removed and building with setup.py is failing (strangely: https://circleci.com/gh/facebookresearch/habitat-sim/988?utm_campaign=vcs-integration-link&utm_medium=referral&utm_source=github-build-link).
I was able to build after running git rm --cached src/deps/tinyobjloader/

Your change seems to be adding the tinyobjloader submodule back:
diff --git a/src/deps/tinyobjloader b/src/deps/tinyobjloader
new file mode 160000
index 0000000..fd06fa4
--- /dev/null
+++ b/src/deps/tinyobjloader
@@ -0,0 +1 @@
+Subproject commit fd06fa49e4e3f4811df4ee566a0ea41832eb0cca

Probably do some git-submodule weirdness.
You should be able to fix by removing the submodule like you did (via git-rm) and then committing that change.


FOSUserBundle authenticated user displayed as anonymous

Hi, there
Environment: Symfony 2.8.14, "friendsofsymfony/user-bundle": "~2.0@dev", "gos/web-socket-bundle": "^1.8"
After authenticated by fosuserbundle, I found I can't get user by user name with clientManipulator. Configuration as below
gos_web_socket:
    server:
        port: 8080
        host: <IP_ADDRESS>
        router:
            resources:
                - @SundayForumBundle/Resources/config/pubsub/routing.yml
    client:
        firewall: main
        session_handler: @session.handler.pdo
        storage:
            driver: @gos_web_socket.server.in_memory.client_storage.driver
            decorator: ~
    pushers:
        wamp:
            host: <IP_ADDRESS>
            port: 8080

fos_user:
    db_driver: orm
    firewall_name: main
    user_class: Sunday\UserBundle\Entity\User
    use_listener: false
    registration:
        form:
            type: Sunday\UserBundle\Form\Type\RegistrationType

services:
    twig.text_extension:
        class: Twig_Extensions_Extension_Text
        tags:
            - name: twig.extension
    pdo:
        class: PDO
        arguments:
            dsn: mysql:host=%database_host%;dbname=%database_name%
            user: %database_user%
            password: %database_password%
        calls:
            - [ setAttribute, [3, 2] ] # \PDO::ATTR_ERRMODE, \PDO::ERRMODE_EXCEPTION
    session.handler.pdo:
        class: Symfony\Component\HttpFoundation\Session\Storage\Handler\PdoSessionHandler
        arguments: [@pdo, {lock_mode: 0, db_table: sunday_session}]

security:

    encoders:
        FOS\UserBundle\Model\UserInterface: bcrypt

    role_hierarchy:
        ROLE_ADMIN: ROLE_USER
        ROLE_SUPER_ADMIN: ROLE_ADMIN

    providers:
        fos_userbundle:
            id: fos_user.user_provider.username_email

    firewalls:
        main:
            pattern: ^/
            form_login:
                provider: fos_userbundle
                csrf_token_generator: security.csrf.token_manager
                default_target_path: /
                use_referer: true
            logout: true
            anonymous: true

    access_control:
        - { path: ^/login$, role: IS_AUTHENTICATED_ANONYMOUSLY }
        - { path: ^/register, role: IS_AUTHENTICATED_ANONYMOUSLY }
        - { path: ^/resetting, role: IS_AUTHENTICATED_ANONYMOUSLY }
        - { path: ^/admin/, role: ROLE_ADMIN }

dump($this->clientManipulator);

#authenticationProvider: Gos\Bundle\WebSocketBundle\Client\Auth\WebsocketAuthenticationProvider {#499
    #tokenStorage: Symfony\Component\Security\Core\Authentication\Token\Storage\TokenStorage {#497
      -token: Symfony\Component\Security\Core\Authentication\Token\AnonymousToken {#940
        -secret: "main"
        -user: "anon-15094988995847ce353bac0404228404"
        -roles: []
        -authenticated: true
        -attributes: []
      }
    }
    #firewalls: array:1 [
      0 => "main"
    ]
    #logger: Symfony\Bridge\Monolog\Logger {#501}
    #clientStorage: Gos\Bundle\WebSocketBundle\Client\ClientStorage {#502}

gos:websocket:server command output

2016-12-07 17:11:49] websocket.INFO: anon-20026516845847d24e4ffcd253729173 disconnected {"connection_id":852,"session_id":"20026516845847d24e4ffcd253729173","storage_id":852,"username":"anon-20026516845847d24e4ffcd253729173"}
[2016-12-07 17:11:49] websocket.DEBUG: INSERT CLIENT 857 {"user":"s:37:\"anon-21354439775847d2557fb64849730617\";"}
[2016-12-07 17:11:49] websocket.INFO: anon-21354439775847d2557fb64849730617 connected {"connection_id":857,"session_id":"21354439775847d2557fb64849730617","storage_id":857}
[2016-12-07 17:11:49] websocket.DEBUG: GET CLIENT 857
[2016-12-07 17:11:49] websocket.INFO: anon-21354439775847d2557fb64849730617 subscribe to sunday/igor
[2016-12-07 17:11:49] websocket.DEBUG: Matched route "igor_topic"
[2016-12-07 17:11:49] websocket.DEBUG: GET CLIENT 857
[2016-12-07 17:11:49] websocket.INFO: anon-21354439775847d2557fb64849730617 publish to sunday/igor
[2016-12-07 17:11:49] websocket.DEBUG: Matched route "igor_topic"
[2016-12-07 17:11:49] websocket.DEBUG: GET CLIENT 857

Any idea? What's wrong with it?

Well, I have a try with WebsocketAppDemo, and I just use memory for authentication, the problem exist as well. By the way It's Symfony 3.2.
security:
    providers:
        in_memory:
            memory:
                users:
                    tony:
                        password: 123
                        roles: 'ROLE_USER'

Test source code here
WebsocketAppDemo-test
It's hard to trace the problem, maybe WebsocketAuthenticationProvider can't get the right Session, and the $connection->Session is empty

Hi,
I have the same problem, did you find the solution?

@nash4ever you're right, I fix it, actually I config it as domain in the yml, but it still not work. Finally, as Jack said, Javascript client must connect to the domain too, but not <IP_ADDRESS> even if it's resolved by /etc/hosts. It's just because the bundle provide a mechanism to protect itself for cross domain websocket call, that's a great feature. Close the issue :) thx


Add option to delete Astropy cache

On the SMCE, users have 10G of disk space by default and I've hit the limit a couple of times. Recently I went hunting deeper for what's taking space and found almost 5G in the Astropy cache:
(science_demo) jovyan@jupyter-raen:~$ du -sh ${HOME}/.astropy/*
4.6G    /home/jovyan/.astropy/cache
4.0K    /home/jovyan/.astropy/config

I wonder if we should add an option to the end of each notebook to delete this cache using https://docs.astropy.org/en/stable/api/astropy.utils.data.clear_download_cache.html.

This cache might be useful when working with the very same datasets, but also, I would not think it's a bad idea to turn caching off in the queries themselves.

I would prefer the option of deleting the cache over the option to turn off caching for a particular query. Reason is because I (or the user) may want to use the cache for a few runs, but not be stuck with it forever (or until they go hunting and find/delete it themselves).

OK, that sounds good. We're also adding more caching docs to astroquery, hopefully that helps, too.

I deleted my cache and executed all the notebooks in this repo that will currently run. They only added about 1M total to ~/.astropy/cache.

800K : forced_photometry
30K : light_curve_generator
160K : scale_up
0 : light_curve_classifier

Not sure how I ended up with 5G in there since I basically only use SMCE to run these notebooks. Doing get_sdss_sample (light_curve) with 50,000 objects adds another 2.5M to the cache, but that's still a long way from 5G.
Those numbers are small enough that I don't think we need to put extra work into the notebooks for it.

We had done some cache refactorings in astroquery, maybe it's due to that. Either way, I'm very happy to hear that this is not a practical issue any more.


Support obfuscation of symbolic information in the precompiler

This is a tracking bug to document implementation and use in TODOs

7d52317 provides initial implementation of the obfuscation.
gen_snapshot and dart_boostrap now support two additional options

--obfuscate which enables obfuscation;
--save-obfuscation-map=<filename> which makes VM store a mapping between original names and obfuscated ones in the given filename. The mapping is encoded as a JSON array [original_name_0, obfuscated_name_0, original_name_1, obfuscated_name_1, ...].

Implementation Details
All identifiers (except those that are forced to have an identity renaming) are renamed when TokenStream is created for the Script.
At the end of precompilation we also collect and rename scripts, libraries and Symbol instances. Libraries and scripts URI are also renamed.
:warning: Because all identifiers are renamed methods like Object.runtimeType, Type.toString, Enum.toString, Stacktrace.toString, Symbol.toString (for constant symbols or those generated by runtime system) will return obfuscated results. Any code or tests that rely on this will break.
:warning: Only constant instances of Symbol are renamed
This means that in the code below const Symbol('secretMember1') will be renamed consistently with secretMember1 identifier in the main(), and similarly #secretMember2 will be renamed consistently with secretMember2 identifier. However new Symbol('secretMember3') will not be renamed in any way because it is not a compile time value. Also notice that resulting snapshot will contain string 'secretMember3' and will not contain strings 'secretMember1' or 'secretMember2'.
class A {
  dynamic noSuchMethod(Invocation inv) {
    if (inv.memberName == const Symbol('secretMember1')) {
      return 'value1';
    } else if (inv.memberName == #secretMember2) {
      return 'value2';
    } else if (inv.memberName == new Symbol('secretMember3')) {
      return 'value3';
    }
    return 'unknown';
  }
}

main() {
  final obj = new A();
  print(A.secretMember1);
  print(A.secretMember2);
  print(A.secretMember3);
  // Unobfuscated AOT build will print: value1, value2, value3
  // Obfuscated AOT build will print: value1, value2, unknown
}

Known Limitations
Obfuscator has a list of identifiers it can't rename for implementation reasons, because compiler, runtime or embedder expect to resolve this identifiers dynamically by unobfuscated name.
The following symbols are not renamed:

entry points specified by embedder and VM internal entry points (e.g. identityHashCode);
pseudo-keywords (e.g. show, hide, await, 'async', etc);
operator names (e.g. *, []=);
internal Dart VM symbols (see runtime/vm/symbols.h);
names of classes and methods that are recognized by the compilation pipeline and intensifier (see runtime/vm/method_recognizer.h).

Full list can be found in the source or extracted from obfuscation map generated by the VM.
Future Work

[ ] This obfuscator is implemented in the classic pipeline, when Kernel becomes default pipeline similar obfuscation would have to be implemented there too;
[ ] Some of the limitations on the obfuscation could be lifted if internal lookups in bootstrapper and in the  compilation pipeline use obfuscator to mangle the names.

@kmillikin I wonder if we can find somebody to look at hooking up obfuscation in the kernel pipeline - it seems @mehmetf is on track hooking it up internally. which means we would need to support it in Dart 2 so that it does not become a blocker for switching to Kernel. Currently it is all done in the tokenizer :-/ Should probably be done in Kernel loader.

marking it P2 for now - because there are more important things for us to tackle.

Thanks for the update.

so that it does not become a blocker for switching to Kernel. Currently it is all done in the tokenizer

I am assuming and hoping that this implies we will not be losing this functionality with switch to Dart 2. Please clarify.

If we are to switch today - then yes, obfuscation would stop working. I don't anticipate us switching before we fix this anyway. I will make sure that this is tracked appropriately.

@jensjoha if you have some cycles, please check out if you can hook up obfuscation in Kernel mode too.

@mraleph qq about obfuscation and dart entrypoints that Android shell uses. We are experimenting with a solution to allow teams embed Flutter into their existing apps. One way to do this is to create multiple entry points in Dart and call into these from Android. Obfuscation would obviously break this.
My question is how does it work today with a single entrypoint (main)? Does obfuscation system know not to mess with main()? Do you have a proposal on how to support this use case? (e.g. don't obfuscate methods that start with a particular prefix?)

@mehmetf in reality there are already multiple entry points into Flutter program - anything that is looked up by its symbolic name from C++ side is a sort of entry point.
Deobfuscation builds on top of the same mechanism that AOT compiler uses and does not obfuscate entry points that are specified by the embedder. In case of Flutter this information comes from a file like this  https://github.com/flutter/engine/blob/master/runtime/dart_vm_entry_points.txt that is fed into VM through gen_snapshot flags.
You can build on top of this.
Another alternative is to build on top of main method:
void main([args]) {
  switch (args.length == 1 ? args[0] : 'default') {
    case 'main0': main0(); break;
  }
}

Kernel support landed yesterday (df92e14975eddf904b84be68da84a89d4b7b779d). Please test and give any feedback.

I consider this as done, even though there might be still some work to make obfuscator more obfuscaty. Thanks for handling this @jensjoha !


Spurious failures in 5.1.x tests.

I've been noticing an increased rate of spurious failures in the Cert_5_1_xx.py tests.
The tests always seem to succeed in the state checks, but fail on the message/sniffer check.  Example output:
FAIL: test (__main__.Cert_5_1_03_RouterAddressReallocation)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/travis/build/jwhui/openthread/examples/../tests/scripts/thread-cert/Cert_5_1_03_RouterAddressReallocation.py", line 126, in test
    leader_messages.next_mle_message(mle.CommandType.PARENT_RESPONSE)
  File "/home/travis/build/jwhui/openthread/tests/scripts/thread-cert/message.py", line 293, in next_mle_message
    assert message is not None, "Could not find MleMessage of the type: {}".format(command_type)
AssertionError: Could not find MleMessage of the type: 10

Some full travis logs attached:

cert_5_1_1.txt
cert_5_1_11.txt

@prfi, would you mind taking a look?

I will check that and I will try to fix.

Fixed by #1324.


/play not always working properly on initial use

Fixed. Issue caused by bot attempting to deafen before joining VC


XIP Flash: Not working as expected

Describe the bug
I implemented a neorv32 soc with XIP support.
I compiled and uploaded the examples in neorv32/sw/example/demo_xip and neorv32/sw/example/demo_blink_led in turns but it got stuck at the erase flash function. A clear and concise description of the bug is show below.
To Reproduce
git clone --recursive https://github.com/fedy0/neo.git && cd neo && make -f Makefile.xip flash
make MARCH=rv32i_zicsr_zifencei USER_FLAGS+="-Wl,--defsym,__neorv32_rom_base=0xe0400000" clean_all exe

Expected behavior
Load executable from flash
Screenshots

Environment:

OS: Ubuntu 22.04
GCC Version: prebuilt toolchain provided by you
Libraries used: newlib

Hardware:

Hardware version: Please see the screenshot
Hardware modifications: XIP support

I think everything looks fine so far...

make -f Makefile.xip flash

What is that?
What kind of serial flash are you using? First, you should check that the chip actually supports all the required commands:
https://github.com/stnolting/neorv32/blob/89d0f9d286f9ae2cdc987324b934ab17327a4d6a/sw/example/demo_xip/main.c#L65-L71
If the program keeps stuck in the erase function the write-in-progress flag of the chip's status register might not be clearing. In most cases (talking about my own mistakes 🙈) this is not caused by the chip itself but by some faulty wiring.
Which chip select line are you using?
This is what I would do: try to make a manual access to the SPI flash to check if the chip is responding at all (thus, verifying the wiring). You can use the provided "SPI explorer program" for that (-> sw/example/demo_spi).
Here is an example session where I am reading the chip's status register after power-up. As you can see, the write-enable latch is cleared at first. After issuing the according enable command the write-enable latch becomes set. If this also works on your side you know that the chip is properly wired up.

I think I will add such a "connection check" to the XIP demo program as well.

I think everything looks fine so far...

make -f Makefile.xip flash

What is that?

This is a makefile to sythesize XIP in the SoC. I have two top level vhdl file in ´./top` so I just use a seperate makefile (although the same thing can be achieved with -DDEFINES)
I am using the ULX3S Board and the SPI flash on it is from issi
The XIP feature is interesting to me because I would like to have firmware retention in order to speed up the arduino-port developement for all the perpherial. I will try what you suggested. Thanks

I have updated the XIP demo program. The new version includes a "connection" check that tries to toggle the write-enable latch of the flash chip.

Hi @stnolting I have made the modification (a crude one though) here.
And the picture below is the outcome.
Just a quick question. Can the SPI used for loading FPGA configuration at power-on be used for program memory simultaneously?

And the picture below is the outcome.

Seems like you are always receiving ones... So maybe the wiring of your SPI flash is incorrect. Maybe SDI and SDO pins are switched?! 🤔

Just a quick question. Can the SPI used for loading FPGA configuration at power-on be used for program memory simultaneously?

Sure, you can do that. You just need to make sure that the images (bitstream and processor executable) do not overlap inside the flash.
You can customize the bootloader (-> UG: https://stnolting.github.io/neorv32/ug/#_customizing_the_internal_bootloader) to set a different base address for the executable image inside the flash (-> SPI_BOOT_BASE_ADDR).

Closing this for now. Feel free to open another issue if you have further questions.


Compile & Link failed on Ubuntu 24.04

Describe the Bug
When compiling the project following the instruction on Ubuntu 24.04, it fails because uint64_t needs header file cstdint included on GCC 13.2.0.
But after change the G++ version to 11.4.0, it fails on linking protobuf dynamic libraries.

But on Ubuntu 22.04, it is OK. So maybe we rely on an older version of libprotobuf? I'm not sure but we need to note this in the build guide.
System Info

OS: Ubuntu 24.04
G++ Version: GCC 13.2.0 / 11.4.0

Hi @HeRaNO thanks for reporting this issue. Solved with #235. Closing.


Feature/exp drop rates commands

Hey again, i've implemented the task 'active gm command for change rates for all channels'
this works for all rates with the command:
/rate <exp | drop | mesos> rate
rate is an int16 because its enough.
extra command: /showRates
so the main logic is when gm exec the command it sends a packet to the world channel which stores the new rates in its memory and also propagate the new rates to all channels which then store them also.
when ever a new channel establishes a connection with the world , world will send its rates through the ChannelOk handler, we want this in cases when a new channel registers/channel restarts after GM executed a command and we want the command to take effect.
the world server initially gets its rates from the config file, and if for example it restarts it will override any new rates GM wrote.

Don't for get to update readme

updated to pr according to latest comments.

CR followup

If the changes are okay with @Hucaru, what would you be interested in working on next, @amityahav?

Changes look ok to me. Do you have any further changes you want to make? If not I will merge this in

If the changes are okay with @Hucaru, what would you be interested in working on next, @amityahav?

I think issue #55 might be a good one to do as after that only preventing a character from being created on a world is left as a login world feature.

I think issue #55 might be a good one to do as after that only preventing a character from being created on a world is left as a login feature.

Could you double check if the readme is up to date?
@ErwinsExpertise did a lot of work, but I'm unsure if Player use item (scrolls, potions etc) and Player drop item(s) were completely implemented in #51. There were a lot of stuff on ErwinsExpertise's plate, and Player skill logic (haste etc) was also among them. Not sure how that's going right now, but I hope we hear back eventually.

I think the readme is missing 3 items for the login server
[ ] Show EULA on first login
[ ] Show gender select on first login
[ ] Allow world locking when full

I think the last one is managed by a single byte in the world description packet

CR follow up

Happy for me to merge?

Yes! Thanks


A few suggestions for the docs search preview text

Apostrophes are missing in the preview, such as "Tangram's styling"
Text with formatting tags, such as backticks, display the tags as spaces, such as "see styles ,"

Archiving this, as it's a known limit on mkdocs.


create CA by default

this is a harmful default. If somebody turns on certManager
without enabling ca creation, the server will never start.

I upgraded the chart and my server didn't start, tracked it to this default of create enabled: false. Removed it from the test, for a better test of user expectation.

Existing users are already managing cert-manager certificates themself. This will break their behavior. Also in my case I need to manage it outside as we have a certain PKI structure on there. We want to leave the default as is and let the user choose to generate the certificate.


Update readme

How to use (in the browser)?
demo.
of course link to the original one, I see you don't use readline but keypress, is it good?

Hi - sorry for the late reply.
You can use this in a bundler like webpack, so it can be used in the browser.  All I did was change the dependencies.  Keypress looked good and reliable to me.


DNSSEC: Lightning Address wallet failures

Unable to receive funds to from set of wallets providers (e.g Phoenix, bitvora) to our Lightning address. Phoenix provides the error: "This address is hosted on an unsecure DNS. DNSSEC must be enabled."

I already enabled this for islandbitcoin.com - I will do the same for flashapp.me

@brh28  for testing, can you send a test payment from phoenix to<EMAIL_ADDRESS>please?

From Flash or from external wallet?

DNSSEC enabled and DS record updated on registrar.
Please test again

Closing as resolved


make helm update to restart container

make helm update to restart container, currently does not

when configMap changes


Implement a proper wellformedness check

This is an attempt at fixing #548
Create a proper context tracking which bindings (types and captures) are in scope and then run the wellformedness check on inferred types.
TODO:

[ ] make sure that we catch all binding occurrences
[ ] make sure that we check all inferred types (type arguments, return types of functions and matches, ...)
[ ] treat existentials properly

Still todo:

[ ] improve implementation and deduplicate
[ ] improve error messages (previously they have been specialized to what kind of capture escaped "local variable ... escapes" instead of "captures {x} escapes ..."

Especially the worse error messages are frustrating. It would be great to look at the diff of this PR and see how we can get this kind of (or better) messages back.


[🐞] computed signals do not get serialized with refs

Which component is affected?
Qwik Runtime
Describe the bug
It seems that Qwik does not register when the computed signal should be serialized.
According to wout, this might be fixed in v2?

Reproduction
https://qwik.builder.io/playground/#v=1.3.5&f=Q0o0xhbG2BKNDqL2BTPhiVlHgfIEBQmd3Mqg1DRg8CCqeY8QXx8ncDvDNScVlFXsNIDuRaiHigJVQ7QhchjCbHggg43XA%2BbX0lSQGbWaXHCTMoDFfE4qpP4GmoSqHbn9gGwlxChNuFGwXAFpGAG5wEYM2M5aRNugGtmmWjswreCbCm9NjeagoZqDAA
Steps to reproduce
Load playground
Click on the button
System Info
N / A

Additional Information
No response

So the problem is the dirty task. Rendering the JSX changes the ref signal, and that in turn marks the useComputed as dirty but doesn't rerun it. The computed signal doesn't get updated and gets serialized as undefined and then on the client it doesn't get updated either.
Not sure how to tackle this.

As you can see, on the server side it never reruns tasks, but on the client side it does:
https://qwik.builder.io/playground/#v=1.4.0&f=7VbLCsIwEPyVHAQrFvEgemoPguJBL%2BIPiKQI1haqPZSSf3d2N01SqOJV8NRHNjuzyT4mSJrVYjmUNLGfvvzqkjlWI8V%2FuNN9kVpyFNtkOLfQ9alJV3gVw3tz1BkOzQ%2F%2F3emwX7P62OSaCiiNEEVnn5VlaB1l5%2FyhJ4E7uwnLYufL0rJQfDyhbBhXdVGQbiHKZDuOCWeG4q%2FZt7tJZiv%2FiZLBohMXUctKwbhY34A8YQ0ANo7Y4UQwHGRC4wTF5qK6Yk7lWgQIogoPtA8Shu%2Fpw1NQ1qLs8AkVxvDGi5s2RDIpP9VBOzkoLeBjF0lSoiW8L72rmhOXjgXpTMlTy8dzIB8XYT%2BdmtTqDZhg5gDEkZHtW3XTTdLaDYazXmQsuP6b1e81qxc
I think we have to check for dirty tasks before outputting the result


show logo instead of text inside map nations

Hi,
is possible show images inside maps instead of text name nations?

Unfortunately, no not currently.
Closing as a duplicate of this issue: https://github.com/alexandersimoes/d3plus/issues/317


req.session.save() overrides existing Set-Cookie header values

https://github.com/vvo/next-iron-session/blob/master/lib/index.js#L62-L65
I "think" this line:  res.setHeader("set-cookie", [cookieValue] is assuming that there were no other attempts to set cookies before calling req.session.save()
It looks like destroy does something similar: https://github.com/vvo/next-iron-session/blob/master/lib/index.js#L73
I think these calls don't seem to keep any existing values in the Set-Cookie header?
This doesn't seem to work:

const postHandler = async (req, res) => {
  destroyCookie({ req, res }, 'token');
  req.session.destroy();
  res.status(200).json({ message: 'logged out' }).end();
};

But this works fine:
const postHandler = async (req, res) => {
  req.session.destroy();
  destroyCookie({ req, res }, 'token');
  res.status(200).json({ message: 'logged out' }).end();
};

*destoyCookie comes from this package: https://github.com/maticzav/nookies which I am using to manage other cookies.
This kind of hung me up a little bit and required a fair bit of debugging and moving code around trying to understand why my extra cookies weren't being set.

@mwisner thanks for the report, I have been working on a fix for this. When this is released can you try again? Thanks!

:tada: This issue has been resolved in version 4.1.5 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:

Hi there, I think #117 fixed req.session.save() but the change was never applied to req.session.destroy()which still seems to override attempts to set a cookies. Atleast for me.

(handling this in another issue @lkbr, solved)

🙏


rewrite output generation using jinja2

Description
Currently, we are generating output XML responses using lxml generation facility. This is no longer possible, since the difference between WPS 2.0.0 and 1.0.0 are relatively big and we need to separate the logic (model) from the representation (view).
I therefore suggest, we introduce templating system again, and this time it should be well know
http://jinja.pocoo.org/
Each version should have it's own directory with templates. This should also lead to major code simplification.

The work is happening here https://github.com/jachym/PyWPS/tree/templates

Sounds like a sensible approach.

I also would prefer using a template engine. There are several ones available for Python. Jinja seems currently to be the favorite one. Jinja is also used by Ansible.

It's used in Django too. License is BSD, so we should be fine

done with PR #345.


GoXLR Utility will not run

When I try to run the goxlr-utility-0.12.5.exe as administrator, I get an error saying "Unable to locate the GoXLR Driver, please ensure it is installed.

So a couple of questions,

Does the official app work without issues?
Are you running a 32bit or 64bit OS?
If you open Regedit and navigate to HKEY_CLASSES_ROOT\CLSID\{024D0372-641F-4B7B-8140-F4DFE458C982}\InprocServer32\ - Do you see the API driver present?
Is your driver installed to the Default Location?

Hopefully these will help track down this issue.
Thanks

Thanks for your reply.

Yes except I have to manually connect to my stream deck recently
64bit
Yes, it is there.  D:\Program Files\TC-HELICON\GoXLR_Audio_Driver\W 10_x64\goxlr_x64.dll
No, I have it in my D: drive

Ok thanks.
You're the second person to report this issue in the last couple of hours, which is wild.
Unfortunately, you may not be able to use the util until the next release, I'm going to need to investigate why having the drivers installed to a different drive is causing issues. I'll keep you updated though.

Awesome!
Thank you so much

Ok I've found the cause, fixed it and generated a test build, could you please download the following:
https://github.com/GoXLR-on-Linux/goxlr-utility/suites/14458134804/artifacts/816440585
And give that installer a try please?
Technical explaination: when the installer runs the first thing it does is check for some registry keys to see if you've installed before. If any of those flag as an 'error', it'll fall back to defaults during the installation (which is good, and desired behaviour). The problem happening here was that those errors simply weren't being cleared, so when it went to do the 'where's the driver?' check, it found the driver, but was picking up the previous errors and failing the check. This build corrects that error.

Sorry, same result

Damn, was rushing for a fix.. Fair enough, I'll take a closer look at this tomorrow and see if I can work out what's going on.

No worries.   Thanks for trying.   My GoXLR is working so no immediate rush.

Just reviewing your responses to the first questionairre, can you confirm the path on point 3 please? I don't know if github mangled it (please wrap it in ` tags, so it looks like this)..

(D:\Program Files\TC-HELICON\GoXLR_Audio_Driver\W 10_x64\goxlr_x64.dll)

Something may be wrong with your driver install, the path I would expect to see is: D:\Program Files\TC-HELICON\GoXLR_Audio_Driver\W10_x64\goxlr_audioapi_x64.dll

'HKEY_CLASSES_ROOT\CLSID{024D0372-641F-4B7B-8140-F4DFE458C982}\InprocServer32'

Could you provide me with a screenshot of the contents of D:\Program Files\TC-HELICON\GoXLR_Audio_Driver\W10_x64 please?

Yes, that is right.  I left out the _ between W10 and x64.... sorry

ok, I'm also seeing github mangling things, all good, I'll do some additional testing this side :)

Thank you for your time

No problem, I've got a new build underway, should be able to send it out shortly :)

Great!

Could you give this build a try please:
https://github.com/GoXLR-on-Linux/goxlr-utility/suites/14458873098/artifacts/816496452

Absolutely

i\It worky!!!   So far anyways

Should I put it in C: or D:?

Put it wherever you want :)

lol

Run utility on startup or use app insted?

You can choose both, I'd recommend running it on startup (although you'll need to disable the official app), and the exeperimental app just makes it run in it's own window, instead of a browser (which a lot of people prefer!)

Can I change it from browser to experimental app in the settings?   I think I would prefer that over the browser too

Currently there's not a quick switch, but you should be able to re-run the installer and tick the box which will set it up

Let me know if everything is good, so I can close this issue as solved :)

Seems to work great.  I just need to bring over my old profiles and presets and samples

Should be simple enough, right click on the tray icon and you can open the relevant util paths, then just grab stuff from the official app (Documents/GoXLR), and you should be good :)

Thank you so much!   I appreciate your time and effort.

No problem, thanks for the detailed reports and switft responses that have helpped with tracking this down, it's very much appreciated. I hope you're able to get everything working right :)

Do the "Recover Defaults" buttons work?

They do, but they wont overwrite existing files, you'll need to remove the default profiles / mic profiles prior to pressing them.

Got it all set up.  I did it the hard way and drug all my old files into the utility.   Works great!
"Truely you are a wizard"

I had the same issue, got it working by creating the path where the driver normally sits manually and reinstalling it to that directory


License

Hi,
your implementation looks interesting and I would like to test it on a project of mine. Would it be possible to release the code under an OSS license?
https://help.github.com/articles/licensing-a-repository/
Best,
ibayer

Hi ibayer,
We added an Apache License.
Thanks,
Lucas Ponce


fraud: implement fraud store

Resolves #535

Codecov Report

Merging #834 (3d9dcc4) into main (63a8c17) will increase coverage by 4.14%.
The diff coverage is 52.58%.

@@            Coverage Diff             @@
##             main     #834      +/-   ##
==========================================
+ Coverage   53.94%   58.08%   +4.14%
==========================================
  Files         122      124       +2
  Lines        6979     7158     +179
==========================================
+ Hits         3765     4158     +393
+ Misses       2826     2539     -287
- Partials      388      461      +73

Impacted Files
Coverage Δ

node/node.go
62.50% <ø> (ø)

fraud/bad_encoding.go
56.25% <33.33%> (+15.65%)
:arrow_up:

header/testing.go
89.56% <34.48%> (-10.44%)
:arrow_down:

das/daser.go
71.42% <40.00%> (-4.89%)
:arrow_down:

fraud/service.go
64.48% <40.00%> (+16.00%)
:arrow_up:

fraud/proof.go
66.66% <50.00%> (ø)

fraud/store.go
51.72% <51.72%> (ø)

fraud/testing.go
58.97% <58.97%> (ø)

service/rpc/middleware.go
76.47% <60.00%> (-23.53%)
:arrow_down:

service/state/service.go
50.00% <75.00%> (+16.66%)
:arrow_up:

... and 15 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 63a8c17...3d9dcc4. Read the comment docs.

For reviewers(@liamsi, @renaynay ), we just had a call with @vgonkivs where we got through some bugs in FraudedLifecycle, which is now changed, but we are pretty sure now that it is bug-free. The main bug was at the intersection of contexts. This PR went a bit out of scope of only storing, but life cycling, which potentially could be abstracted into separate PR, but I don't mind having it here with a simple update of the name + description.


Added example to search a package

Simple example to search a package
Command:
cargo run --example search_package --features="search" $PKG_NAME
Example Output:

Looks good - thankyou!


Accessability - compare with JS/CSS disabled

when CSS and JS disabled on the compare site selecting something impossible like sales volume for UK generates the 'something has gone wrong' message.
we should perhaps have a 'no data available for that selection' message rather than a default

Fix deployed

confirm fixed


Best Practices Analyzer for Hyper-V: link updated

Description:
As stated in issue ticket #810 (Link to Best Practices Analyzer is outdated?), the existing Best Practices Analyzer URL links to the 2008 R2 page version.
Thanks to @olavt for reporting the issue.
My suggestion is to replace it with the 2012/2012 R2 page version, even if the new page link also belongs to the /previous-versions/ hierarchy.
I have made some effort to locate a similar Windows Server 2016 page, but those are mostly troubleshooting pages only, not general topic documentation pages.
Additional changes:

added editorial blank line between the page index and the page title line
added MarkDown indent marker compatibility spacing in > Applies To:

Ticket closure or reference:
Closes #810

#sign-off