Reverb not broadcasting the  event on channel

Reverb Version
@beta
Laravel Version
11
PHP Version
8.2
Description
i am using Apache Cpanel my connection to Reverb is successful  and events are being subscribed channels
but when am  broadcasting message  not a single error and message is not being broadcast on channel not either in debug.
but when I use
BROADCAST_DRIVER=reverb**
I get this error

if I don't use  BROADCAST_DRIVER AND  only use BROADCAST_CONNECTION=REVERB . then event is not being broadcaster
Steps To Reproduce
BROADCAST_DRIVER=reverb
BROADCAST_CONNECTION=reverb
CACHE_DRIVER=file
FILESYSTEM_DISK=public
QUEUE_CONNECTION=database

channels are being subscribed but events are not broadcast to that channel not shown in debug either and the job is completed successfully without error.
but if I add
BROADCAST_DRIVER = reverb
start getting this error

my echo file is as follow
window.Pusher = Pusher;
window.Echo = new Echo({
broadcaster: 'reverb',
key: import.meta.env.VITE_REVERB_APP_KEY,
wsHost: import.meta.env.VITE_REVERB_HOST,
wsPort: import.meta.env.VITE_REVERB_PORT ?? 80,
wssPort: import.meta.env.VITE_REVERB_PORT ?? 443,
forceTLS: (import.meta.env.VITE_REVERB_SCHEME ?? 'https') === 'https',
enabledTransports: ['ws', 'wss'],
});
reverb config is
    'reverb' => [
        'host' => env('REVERB_SERVER_HOST', '<IP_ADDRESS>'),
        'port' => env('REVERB_SERVER_PORT', 8080),
        'hostname' => env('REVERB_HOST'),
        'options' => [
            'tls' => [
                'local_cert' => env('REVERB_LOCAL_CERT',null),
                'local_pk' => env('REVERB_LOCAL_PK',null),
                        'passphrase' => null,
                        'verify_peer'=>false,
                        'verify_peer_name'=>false,
                ],
        ],
        'max_request_size' => env('REVERB_MAX_REQUEST_SIZE', 10_000),
        'scaling' => [
            'enabled' => env('REVERB_SCALING_ENABLED', false),
            'channel' => env('REVERB_SCALING_CHANNEL', 'reverb'),
            'server' => [
                'url' => env('REDIS_URL'),
                'host' => env('REDIS_HOST', '<IP_ADDRESS>'),
                'port' => env('REDIS_PORT', '6379'),
                'username' => env('REDIS_USERNAME'),
                'password' => env('REDIS_PASSWORD'),
                'database' => env('REDIS_DB', '0'),
            ],
        ],
        'pulse_ingest_interval' => env('REVERB_PULSE_INGEST_INTERVAL', 15),
        'telescope_ingest_interval' => env('REVERB_TELESCOPE_INGEST_INTERVAL', 15),
    ],

],

broadcasting file is

'reverb' => [
'driver' => 'reverb',
'key' => env('REVERB_APP_KEY'),
'secret' => env('REVERB_APP_SECRET'),
'app_id' => env('REVERB_APP_ID'),
'options' => [
'host' => env('REVERB_HOST'),
'port' => env('REVERB_PORT', 443),
'scheme' => 'http',
'useTLS' => 'false',
'curl_options' => [
'CURLOPT_SSL_VERIFYHOST' => 0,
'CURLOPT_SSL_VERIFYPEER' => 0,
],
],
'client_options' => [
// Guzzle client options: https://docs.guzzlephp.org/en/stable/request-options.html
'verify' => false,
],
],

It looks like you are running a secure server so think you will need to broadcast over https.

Closing this issue because it's inactive, already solved, old or not relevant anymore. Feel to open up a new issue if you're still experiencing this.


Bug in lima

Hi, I found a bug in lima (lima 1.11.0 (commit v1.11.0))
If lima is run after ccs, it is not retaining the full read name.
After ccs --by-strand, the read name is in the format:
m54312U_200904_200413/44/ccs/fwd
After lima, the read name is in the format:
m54312U_200904_200413/81/ccs
The 'fwd' and 'rev' signifiers are removed. This is a definite bug.
There is no reason that the read name should be modified by lima. It should be forwarded exactly as it is.
Can you please fix this?
Thanks.

I'll have a look at it.

Please use the latest lima, version 2.0.0. It has been fixed using BAM as in and output.


Use http when relaying selenium commands through sauce connect tunnel

We should be using http when selenium commands are being relayed through sauce connect tunnel (i.e. when this.config_.sauceSeleniumAddress is specified).
Use https://SAUCE_USERNAME:SAUCE_ACCESS_KEYondemand.saucelabs.com:443/wd/hub when this.config_.sauceSeleniumAddress is NOT specified.

I signed it!

I signed it!

@mgiambalvo Can you please review and merge? Happy to clarify and answer any questions as needed (:
Hope all is well with you!

@wyvern8 I don't think that is necessary, as people were relaying through sauce connect tunnel due to lack of having 'https' endpoint. Now since we have the 'https' endpoint, users have have moved to using 'https://ondemand.saucelabs.com' and using their internal proxy if needed.
Sauce wants to discourage the use of relaying through tunnels (for various reasons) and have them go to 'https://ondemands.saucelabs.com' and use company/corporate proxy to get there if needed.
Let me know if you that makes sense or if you have any questions. Also, it might be likely that I am missing something or misunderstanding (:.
With the current code in place, relaying through sauce connect tunnel would not work as it will try to go through 'https://USERNAME:ACCESS_KEY@sauceconnect.tunnel.com:SELENIUM_LISTENER_PORT' and SELENIUM_LISTENER_PORT will not be 443.

OK. Makes sense.  Agree we should get this in now, and can look at options later if people need it.

@wyvern8 Sounds good. What are the next steps for getting this in? Can you merge this in?

Fixed and rebased @wyvern8 and @wyvern8 !
Look forward to issuing more PRs to Protractor.
Keep up the great work (:

Circle CI build is failing due to jasmine timeouts / test taking too long (unrelated to this change).
...............................[04:37:09] I/launcher - Running 1 instances of WebDriver
[04:37:09] I/hosted - Using the selenium server at http://localhost:4444/wd/hub
Started
FA Jasmine spec timed out. Resetting the WebDriver Control Flow.

Failures:
1) timeout spec should timeout due to jasmine spec limit
  Message:
    Error: Timeout - Async callback was not invoked within timeout specified by jasmine.DEFAULT_TIMEOUT_INTERVAL.
  Stack:
    Error: Timeout - Async callback was not invoked within timeout specified by jasmine.DEFAULT_TIMEOUT_INTERVAL.
        at ontimeout (timers.js:365:14)
        at tryOnTimeout (timers.js:237:5)
        at Timer.listOnTimeout (timers.js:207:5)

1 spec, 1 failure
Finished in 1.415 seconds

[04:37:11] I/launcher - 0 instance(s) of WebDriver still running
[04:37:11] I/launcher - chrome #01 failed 1 test(s)
[04:37:11] I/launcher - overall: 1 failed spec(s)
[04:37:11] E/launcher - Process exited with error code 1

>>> fail: Error: expecting test max duration: 1000, actual: 1402

@cnishina how should we progress this?  Do you have other suggestions, or should @ndmanvar rebase and try again?  If we want to look at setting protocol/scheme as a separate parameter that is doable too.

@wyvern8 @cnishina Just merged master back in and all checks have passed.

Sorry for the extreme delay on this. Could you please rebase and push, and then I'll merge it in. Thanks for your help!

I signed it!

I signed it

Closing this and opening a new PR, as I am having Google CLA email / commit problems. @heathkit

Closing this one and re-opening as https://github.com/angular/protractor/pull/4228 in order to solve Google CLA email / commit alignment problems (I changed the email and recommitted, and issued a new PR).


[T4A6][W09-B1]Yeo Xiang Guang Brandon

Ready for review.

Some comments added. Please close the PR after reading comments.


a hack to mitigate bootstrap_pipe overflow bug

#3527 mentions this kind of error.

#3527 mentions this kind of error.

I believe it's irrelevant to this PR. Because in Testnet, block-window-duration is 5 min, it's quite long compared to 15 secs of initialization. While in integration test, block-window-duration is 2 secs, so if the bootstrap controller is blocked by 15 secs then bootstrap-pipe has a high chance of overflow.
I believe there would be other reasons for the pipe to be overflowed. The issue you pointed out may be caused by one of those.


Initial port to @thorpej's 6809 Playground computer.

Uses Playground OS console I/O routines in lieu of direct hardware access.  Each program's code lives in its own banked ROM bank, for now.  Once Playground OS has file system access routines, the programs will be changed to run from high banked RAM.

Not quite ready to merge yet, but ready to start reviewing!


Edit form not loading checkbox value

Laravel Version: 5.5.20
PHP Version: 7.1.10
Laravel-admin: 1.5

Description:
First of all thank you for this amazing library. I got a kickass admin panel up and running in a matter of minutes :heart_eyes:.
Regarding the issue that I am facing. I have a column which stores a boolean value (published). If it's true it means that the administrator has approved the News.
Everything works fine inside the grid() method, it's showing the correct value from the database but for some reason while editing the resource the checkbox is not checked even if the value in the database is true.
Most probably is my fault can anyone please help me? Many thanks!
Code in NewsController.php that renders the checkbox:
$form->checkbox('published', 'Published')->options(['published' => 'Yes']);
Mutator that converts array type into string:
public function setPublishedAttribute($value)
{
   if(in_array('published', $value))
     $this->attributes['published'] = true;
   else
     $this->attributes['published'] = false;
}

Use Switch function without setAttribute
$states = [
    'on'  => ['value' => 1, 'text' => 'Published', 'color' => 'success'],
    'off' => ['value' => 0, 'text' => 'Draft', 'color' => 'danger'],
];

$form->switch($column[, $label])->states($states);

Use accessors. Mutators to save data to the database, acessors to retrieve data from database.
public function getPublishedAttribute($value)
{
return $value == true ? 'published' : '';
}


EMA with high decay results in worse performance because of 1) no zero-init and 2) no debias.

When using ModelEMAV2 with decay >=0.99999 and ~25k iterations, performance is worse than expected.
Encountered this bug when fine-tuning on ImageNet with EMA.
Fixed this locally by following the optax implementation of EMA, posting here in case other people encounter the same thing.
There are two things which differ in the optax implementation.

EMA is initialized with zeros.
Bias correction is applied to EMA.

Apologies if I am missing something or mis-using the timm EMA implementation. Just figured this would be helpful to post in case others are using EMA with high decay. If I am not missing something, I'm happy to submit a PR for this.

@mitchellnw I've noted that both TF and Optax have that option but have yet to find time to compare... although for fine-tune if EMA is initialized from the weight it seems that it should work okay? 0.99999 is a pretty small decay, by my calcs you'd want something in the range of 200k steps for that...  .99995 - .99997 would be more suitable for 25k steps
Regardless, I would definitely like a PR to add the option of both zero init and debias. There have been some failure cases for EMA (such as zero_init_bn in ResNets, and some weird behaviour with sync bn that may be helped by this as well)

Sounds good, I'll close this issue and submit a PR this week or next.

Hi, I am wondering what exactly the failure cases of sync bn as you mentioned are? I recently run into a situation where the ACC of ema is around 1% lower than the trained model when using sync bn. Is this because of the combination of sync bn and EMA? Any response will be highly appreciated!


feat: support complex types and use get_columns implementation of starrrocks python client

SUMMARY

support complex types:

largeint
json
percentile
hll
bitmap

remove get_columns from db_spec to use the dialect's implementation of starrocks own python client
update logo image

BEFORE/AFTER SCREENSHOTS OR ANIMATED GIF

TESTING INSTRUCTIONS

ADDITIONAL INFORMATION

[ ] Has associated issue:
[ ] Required feature flags:
[ ] Changes UI
[ ] Includes DB Migration (follow approval process in SIP-59)

[ ] Migration is atomic, supports rollback & is backwards-compatible
[ ] Confirm DB migration upgrade and downgrade tested
[ ] Runtime estimates and downtime expectations provided

[ ] Introduces new feature or API
[ ] Removes existing feature or API

Looks reasonable to me, but deferring to @john-bodley @betodealmeida and @villebro who will be better at spotting the "gotchas" than I am ;) Much appreciated!

Thanks @miomiocat for the PR. Would you mind:

Resolving the merge conflict.
Running tox -e pre-commit locally? We added the pyupgrade hook which rewrites type hints.

Thanks @miomiocat for the PR. Would you mind:

Resolving the merge conflict.
Running tox -e pre-commit locally? We added the pyupgrade hook which rewrites type hints.

Done, please take a look at this PR


Truncate device name to 15 characters

close #503

Now that the cache is working for unit tests (probably got issues with the double run) it's getting even better

EVEN BETTER

Now that the cache is working for unit tests (probably got issues with the double run) it's getting even better

Hah. It'll get even when some of the concurrency limitations I introduced get fixed so that we can revert the tests involving devices back to async: true. I had to set them to sequential mode to prevent deadlock issues :-/. Not my proudest moment as an engineer 😅


Support Middleware with UseContainerMiddleware Function

Add a method, UseContainerMiddleware, that allows adding a single middleware function that takes both the application’s container and the HTTP request as parameters. This will allow us to apply additional context-aware processing, such as authorization, logging, or validation, on a per-request basis.
Proposed Solution:
Implement UseContainerMiddleware, which will add a single middleware function utilizing the container.
Ensure UseContainerMiddleware does not interfere with the existing UseMiddleware, enabling both methods to be used interchangeably as needed.
The UseContainerMiddleware method would look like this:
func (a *App) UseContainerMiddleware(fn func(c *container.Container, r *http.Request) (int, error)) {
	a.httpServer.router.Use(func(h http.Handler) http.Handler {
		return http.HandlerFunc(func(writer http.ResponseWriter, request *http.Request) {

			// Execute user-defined middleware function with the shared container
			status, err := fn(a.container, request)
			if err != nil {
				// Use the returned status code for custom responses
				http.Error(writer, err.Error(), status)
				return
			}

			// Call the next handler in the chain if no error
			h.ServeHTTP(writer, request)
		})
	})
}

I’m currently testing this implementation to ensure it meets all requirements. If the tests are successful, I’ll create a PR for review. Please let me know if you have any concerns.

func (a *App) UseContainerMiddleware(fn func(c *container.Container, handler http.Handler) http.Handler) {
	a.httpServer.router.Use(func(h http.Handler) http.Handler {
		// Wrap the provided handler `h` with the middleware function `fn`
		return fn(a.container, h)
	})
}

updated one


server crashed on a few minutes of high load with Maximum call stack size exceeded error

I've tried to have 2000 users subscribing to 200 channels and publishing on those channels. After a few minutes, the server crashes with  Maximum call stack size exceeded error:
RangeError: Maximum call stack size exceeded
    at PublishState.ResultsHolder.release (node_modules\fastseries\series.js:99:22)
    at ResultsHolder.release (node_modules\fastseries\series.js:99:22)
    at Aedes.defaultPublished [as published] (node_modules\aedes\aedes.js:312:3)
    at PublishState.callPublished (node_modules\aedes\aedes.js:210:15)
    at makeCall (node_modules\fastseries\series.js:113:10)
    at MQEmitter.ResultsHolder.release (node_modules\fastseries\series.js:96:9)
    at MQEmitter.parallel [as _parallel] (node_modules\fastparallel\parallel.js:25:12)
    at MQEmitter._do (node_modules\mqemitter\mqemitter.js:127:8)
    at released (node_modules\mqemitter\mqemitter.js:61:12)
    at MQEmitter.parallel [as _parallel] (node_modules\fastparallel\parallel.js:26:7)
    at MQEmitter._do (node_modules\mqemitter\mqemitter.js:127:8)
    at released (node_modules\mqemitter\mqemitter.js:61:12)
    at MQEmitter.parallel [as _parallel] (node_modules\fastparallel\parallel.js:26:7)
    at MQEmitter._do (node_modules\mqemitter\mqemitter.js:127:8)
    at released (node_modules\mqemitter\mqemitter.js:61:12)
    at MQEmitter.parallel [as _parallel] (node_modules\fastparallel\parallel.js:26:7)

this is my test file:
aedes-test.zip
I run server.js first (I have redis up with it's docker image having 2GB memmory docker run -d -p 6379:6379 redis)
then I run high-load.js and after few minutes (after all users connected and subscribed to channels), hig load test script starts logging user x reconnecting  without any success and then server crashes with error written above.

also, I observed server memory usage increasing as the time passed. I'm not sure whether it's a memory leak or it's normal. but if I didn't have enough memory, the server would close with this error:
<--- Last few GCs --->

[100116:0000016F65E33CD0]   273887 ms: Scavenge 254.2 (320.7) -> 253.7 (323.7) MB, 11.1 / 0.0 ms  allocation failure
[100116:0000016F65E33CD0]   274403 ms: Mark-sweep 255.2 (323.7) -> 254.4 (283.2) MB, 403.8 / 0.0 ms  low memory notification GC in old space requested
[100116:0000016F65E33CD0]   274840 ms: Mark-sweep 254.4 (283.2) -> 254.4 (265.2) MB, 436.6 / 0.0 ms  low memory notification GC in old space requested

<--- JS stacktrace --->

FATAL ERROR: Committing semi space failed. Allocation failed - process out of memory
 1: 00007FF69A9E4376
 2: 00007FF69A9E57D0
 3: 00007FF69B028285
 4: 00007FF69B028158
 5: 00007FF69AF1A105
 6: 00007FF69AF18A71
 7: 00007FF69AF185C5
 8: 00007FF69B04F3FC
 9: 00007FF69A920AF4
10: 00007FF69A95C448
11: 00007FF69A959517
12: 00007FF69AA2809F
13: 00007FF69AA3A099
14: 00007FF69AA3AE5B
15: 00007FF69A9EC78E
16: 00007FF69A9ECBDF
17: 00007FF69A9ECF4A
18: 00007FF69B383EF1
19: BaseThreadInitThunk
20: RtlUserThreadStart

I have also executed the test on a MacOSX, there seems to be a memory leak somewhere, the server increased the memory with each batch of test clients and finally crashed with the following backtrace:
`<--- Last few GCs --->
[3489:0x102801600]   464142 ms: Mark-sweep 1402.9 (1446.8) -> 1402.9 (1445.8) MB, 2026.1 / 0.0 ms  (+ 0.0 ms in 0 steps since start of marking, biggest step 0.0 ms, walltime since start of marking 2026 ms) last resort
[3489:0x102801600]   466153 ms: Mark-sweep 1402.9 (1445.8) -> 1402.9 (1445.8) MB, 2011.3 / 0.0 ms  last resort
<--- JS stacktrace --->
==== JS stack trace =========================================
Security context: 0x161cc74266a1
1: new constructor(aka ResultsHolder) [/Users/alin./Downloads/aedes-test/node_modules/fastseries/series.js:~80] [pc=0x2d64795e6616](this=0x5a81d549981 <a ResultsHolder with map 0x3a7128a1ca31>,_release=0x3f9f14182311 )
2: arguments adaptor frame: 0->1
4: get [/Users/alin./Downloads/aedes-test/node_modules/reusify/reusify.js:~7] [pc=0x2d647956ca75](this=0x11b1ec68fa99 <an ...
FATAL ERROR: CALL_AND_RETRY_LAST Allocation failed - JavaScript heap out of memory
1: node::Abort() [/usr/local/bin/node]
2: node::FatalException(v8::Isolate*, v8::Localv8::Value, v8::Localv8::Message) [/usr/local/bin/node]
3: v8::internal::V8::FatalProcessOutOfMemory(char const*, bool) [/usr/local/bin/node]
4: v8::internal::Handlev8::internal::JSFunction v8::internal::Factory::Newv8::internal::JSFunction(v8::internal::Handlev8::internal::Map, v8::internal::AllocationSpace) [/usr/local/bin/node]
5: v8::internal::Factory::NewFunction(v8::internal::Handlev8::internal::Map, v8::internal::Handlev8::internal::SharedFunctionInfo, v8::internal::Handlev8::internal::Object, v8::internal::PretenureFlag) [/usr/local/bin/node]
6: v8::internal::Factory::NewFunctionFromSharedFunctionInfo(v8::internal::Handlev8::internal::Map, v8::internal::Handlev8::internal::SharedFunctionInfo, v8::internal::Handlev8::internal::Object, v8::internal::PretenureFlag) [/usr/local/bin/node]
7: v8::internal::Runtime_NewClosure_Tenured(int, v8::internal::Object**, v8::internal::Isolate*) [/usr/local/bin/node]
8: 0x2d64790043a7
Abort trap: 6`

@ahmadalli Can you run the same test with your server.js configured with mqemitter-redis instead of the default emitter and see if the same happens?

@behrad yes. this happens again. see the code: aedes-test.zip
this time with this error:
server listening on port 1883
events.js:165
      throw er; // Unhandled 'error' event
      ^

Error: connect ETIMEDOUT
    at Socket.<anonymous> (node_modules\ioredis\lib\redis.js:289:21)
    at Object.onceWrapper (events.js:272:13)
    at Socket.emit (events.js:180:13)
    at Socket._onTimeout (net.js:396:8)
    at ontimeout (timers.js:466:11)
    at tryOnTimeout (timers.js:304:5)
    at Timer.listOnTimeout (timers.js:267:5)
Emitted 'error' event at:
    at Redis.<anonymous> (node_modules\mqemitter-redis\mqemitter-redis.js:54:16)
    at Redis.emit (events.js:180:13)
    at Redis.silentEmit (node_modules\ioredis\lib\redis.js:472:22)
    at node_modules\ioredis\lib\redis\event_handler.js:114:10
    at Socket.<anonymous> (node_modules\ioredis\lib\redis.js:293:43)
    at Object.onceWrapper (events.js:272:13)
    [... lines matching original stack trace ...]
    at Timer.listOnTimeout (timers.js:267:5)

this happens again. see the code: aedes-test.zip

Please post the sample code formatted in github markup, instead of a zip file. Thats makes it easier to move on.

this is my server (with redis emitter and redis persistance)
var aedesPersistenceRedis = require("aedes-persistence-redis")
var redis = require('mqemitter-redis')
var mqttOpts = {
    mq: redis({
        port: 6379,
        host: '<IP_ADDRESS>',
        db: 4
    }),
    persistence: aedesPersistenceRedis({
        port: 6379, // Redis port
        host: '<IP_ADDRESS>', // Redis host
        family: 4, // 4 (IPv4) or 6 (IPv6)
        db: 0,
        maxSessionDelivery: 200, // maximum offline messages deliverable on client CONNECT, default is 1000
        packetTTL: function (packet) { // offline message TTL, default is disabled
            return 15 * 60 //seconds
        }
    })
}

var aedes = require('aedes')(mqttOpts)
var server = require('net').createServer(aedes.handle)
var port = 1883

server.listen(port, function () {
    console.log('server listening on port', port)
})

and this is my load-test:
"use strict";

const mqtt = require('mqtt');

const usersCount = 2000;
const usersPergroup = 10;
const userMessagePerSecond = 10;

const userMessageInterval = 1000 / userMessagePerSecond;
const groupsCount = usersCount / usersPergroup;

console.log(`user message interval: ${userMessageInterval}`);
console.log(`count of groups: ${groupsCount}`);

for (var groupId = 0; groupId < groupsCount; groupId++) {
    const groupTopic = `test/group/${groupId}`;
    for (var userId = groupId * usersPergroup; userId < (groupId + 1) * usersPergroup; userId++) {
        runUserClient(userId, groupTopic);
    }
}

function runUserClient(userId, groupTopic) {
    const userClient = mqtt.connect('mqtt://localhost', {
        clientId: `highload-test-${userId}`,
        clean: false
    });

    userClient.on('connect', function () {
        console.log(`user ${userId} connected`);
        userClient.subscribe(groupTopic);
        console.log(`user ${userId} subscribed to group topic ${groupTopic}`);

        var messageNumber = 1;
        setInterval(function () {
            const message = `from ${userId} - ${messageNumber}th message`;
            userClient.publish(groupTopic, message, {
                qos: 0
            });
            messageNumber++;
        }, userMessageInterval);

    });

    userClient.on('reconnect', function () {
        console.log(`user ${userId} reconnecting`);
    });

    userClient.on('offline', function () {
        console.log(`user ${userId} offline`);
    });

    userClient.on('error', function (error) {
        console.log(`user ${userId} client error: ${error}`);
    });

    // userClient.on('message', function (topic, message) {
    //     console.log(`user ${userId} received message: ${message}`);
    // });
}

I'll try to fix the redis issue and report back again

I'm getting subscribe scheduled to be closed ASAP for overcoming of output buffer limits. in redis for the emitter redis while the client type is Normal and there's no limitations for normal clients in configs.

subscribe scheduled to be closed ASAP for overcoming of output buffer limits

Are you seeing this in your redis console? Strange!
is that a cloud redis instace or a standalone local one?

it's local server

it's my local computer

Check if these helps:
https://stackoverflow.com/questions/32879499/redis-replication-and-client-output-buffer-limit
https://groups.google.com/forum/#!topic/redis-db/LHnNzDU4C-0


Framing or not depending on the command output size

Minor extraterm annoyance: while I like those frames and enjoy them (especially that they make command status so visible), I feel my terminal is sometimes a little filled when I issue a few commands with short output, like pwd or date. I blacklist them in Settings, but this is somewhat cumbersome, and it turns out there are more of them than I expected.
What about an option like
[x] Don't frame commands with single-line output

or maybe a bit more fine-tuning of this kind (set minimal number of lines to get the frame, treat this option differently depending whether command succeeded or failed…).
In general this is about possibility to have some wider rules when to use frames, and when not instead of limiting to simple names.
PS This can also help in case of multicommands like git or hg. I want frame for hg status. I don't want it for hg id

Added in v0.46.0.


avoid collision with fusepy package name

avoid ImportError on colliding fusepy package name fuse. When I tried to launch the fuse.py it does this import:
from fuse import FUSE, FuseOSError, Operations
trying to import himself and not the fusepy package.
I proposed passthrough.py to be consistent to the name of the fuse-filesystem.
PS
Great Example!

Good catch, thank you!


[Feature Request] Post-order traversal of a binary search tree (BST)

Feature Request
Is your feature request related to a problem? Please describe.
Currently, the application does not support post-order traversal for binary search trees. While other traversal methods (such as in-order and pre-order) are available, post-order traversal is missing, which limits the ability to process nodes in a left → right → root order.
Describe the solution you'd like
I would like to add post-order traversal functionality to the binary search tree module. This will allow users to traverse and process the tree in the left subtree → right subtree → root order, which is particularly useful in certain tree-based algorithms like deletion operations and expression tree evaluations.
Describe alternatives you've considered
An alternative could be manually implementing post-order traversal in each application that requires it, but that would lead to code duplication and a lack of consistency in how tree traversals are handled across the system.
Additional context
Adding post-order traversal will complete the set of standard binary tree traversal methods and make the tree module more robust for different use cases.

Would you like to work on this feature?

[x] Yes
[ ] No

@ajay-dhangar can you please look into this and i also done this please merged it
https://github.com/ajay-dhangar/algo/issues/569

#635 .done

@ajay-dhangar can you please look into this for mergeing


Kompiling with --coverage shouldn't require changes to the definition

Currently kompile --coverage requires that KWasm manually import K-IO module, which is annoying because K-IO isn't used anywhere else in that definition.
If K-IO is indeed required, we should automatically import it when kompile --coverage is called.

This should be fixed now. If there is an example where it's not, please open reproduction steps in a new issue.


Atom feeds not being accepted

I've tried two different ones, but it seems the bot is not accepting atom feeds, though the same ones as rss do work.
One of them: rss, https://www.animenewsnetwork.com/all/rss.xml, atom https://www.animenewsnetwork.com/all/atom.xml

I will test it later today. I've tried some atom feeds and they worked. Possibly didn't consider different combination of available fields.

I'm not sure what's wrong. There are some atom and rss feeds which syndication feed says they're invalid. Other one's work fine. Needs further investigation. I think i'll need to write custom parsers, or use some which are already written for older versions of those standards.

Is not working.
https://animesvision.net/beta/rss/lancamentos.rss

appearantly it does work for youtube channel feeds like https://www.youtube.com/feeds/videos.xml?channel_id=UCa9qpOXTVcj1iFMlgg0fOxw either

it doesnt work using Twitter RSS fetch https://twitrss.me/ example :  https://twitrss.me/twitter_user_to_rss/?user=eslrainbowsix

http://store.steampowered.com/feeds/news.xml doesn't work

Hacktoberfest is over :p

any reddit feed will not work. they use ATOM feed.
e.g https://www.reddit.com/r/AskReddit.rss

Even the populair 9gag feeds doesn't work! O_O
http://www.9gag-rss-feed.ovh/rss/9GAG_-_Hot.atom
How do we get the hottest meme's to discord now 🤔

I might know someone that can provide a fix for this and will contact them and query if they can help. I'll let you know if I can indeed get their help.

Someday™ 😉


How to Get Verified Blue tick in flutter

Steps to Reproduce

Run flutter create bug.
Update the files as follows: ...
...

Expected results:
Actual results:

Logs

Hi @manu223
can you please provide your flutter run -v, flutter doctor -v, and complete minimal reproduction code?
Thanks.

The Github issue tracker is for bugs and features requests for the Flutter SDK. Help and support questions like these are better suited for Q&A sites like StackOverflow or on one of the flutter community sites at https://flutter.dev/community .


Merge pull request #1 from cs231n/master

cs231n updated with new commits

updated

closing because this looks empty?


Record the ASG min-size and amount of time it is shutdown in logs/audit so we can calculate cost-savings.

When attempting to calculate the cost-savings of revolver (using external processes) over a given period:

For vanilla EC2/RDS, we can calculate the average hourly cost from the billing data (for the hours it is up),  then multiply that by the number of hours not-up to figure out the savings.   (assuming it would have been 24/7)

But for ASG/Clusters we need to know how many unit-hours were saved (which is min-size * number of hours), which can't be determined from the billing data alone.

We can mostly just ignore ASGs and count the EC2s that were stopped along with the ASG, and assume that's the number/type of resources that are solved over the shutdown period.  At least until we terminate instances instead per https://github.com/Innablr/revolver/issues/277


Installation documentation needs update

In the installation instructions this is mentioned:
composer require "tractorcow/silverstripe-fluent" "3.1.*-dev"
You wil get and old version of Fluent if you use it.
Maybe change it to:
composer require "tractorcow/silverstripe-fluent" "3.5.*-dev"

composer require tractorcow/silverstripe-fluent ^3.5

Thanks, fixed!


Revert PR #79492

This reverts commits from PR #79492 as it's causing a couple of regressions/failures in main and is starting to make people's PR with unrelated changes fail.

I have fix for that in #82787.

Half of the reason for the revert was fixed with #82787.
Holding off on the full-on revert as there might be another fix coming up for the other build error

Proper fixes were integrated. Closing (and thanks @nordic-krch!)


landen sequence objects

Basically static array with two tuples to store ascending or descending sequences.
Using tuples to improve compiler optimization.
Idea is to re-use computations for K, pq, and am functions at different u/z , and possibly support complex inputs.
Test table from online, looking for more, and to have tests for doubling of K′/K and other properties from tables.
Issue with descending from k close to one. also, need to perform analysis of error propagation.
Not sure on package (sub-module) structure, so open to restructuring

Sorry, I've been busy and haven't had a chance to review this.

I'm rewriting a lot of this, and restructuring it as I add more functions, so its actually for the best


V3.7.1 has .sln file referencing missing files in Visual Studio Pro 2013

On downloading and unzipping cpputest-3.7.1, I opened CppUTest.sln.
In project CppUTest, it shows the following files which are not present in the .zip file:

include\CppUTest\EqualsFailure.h   --> contents appear to have been moved to TestFailure.h
include\CppUTest\Failure.h --> used?
include\CppUTest\MemoryLeakWarning.h --> not sure, now MemoryLeakWarningPlugin.h?
include\CppUTest\MockTestOutput.h --> used?
include\CppUTest\NullTest.h  --> not sure, now NullTestPlugin.h?
src\Platforms\VisualCpp\Platform.h  --> now UTestPlatform.h?
include\CppUTest\RealTestOutput.h  --> used?
include\CppUTest\SimpleStringExtensions.h --> not sure, now in SimpleString.h?
include\CppUTest\TestInstaller.h --> appears to be defined in UTest.h
include\CppUTest\VirtualCall.h --> used?

Plus any files which are needed but not included in the .sln file.
Is Visual Studio currently intended to be supported, please?
Thank you,
Scott

Hi Scott,
Visual Studio is fully supported. Most issues with VS have been fixed since 3.7.1 and are fine in the current Head. However, there has not been an official release since 3.7.2. You may want to try the current Head. I don't see any of these headers in the .vcxproj files (CppUTest_VS201x.sln).
Having said that, it appears that at least some of the superfluous header entries you mention are still around in project files for older versions of VC (CppUTest.sln, CppUTest.dsw), namely:
- CppUTest.vcproj
- CppUTest.dsp
While this doesn't seem to cause any harm, it should probably be fixed.

@basvodde do we still need to keep this open? All of this (and more) should be fixed in Head, and for all I can tell we are not going to 'fix' 3.7.1 anymore.

Ok closed.


Change architecture to pass parameters using ROS Params instead of command line args.

Change architecture to pass parameters using ROS Params instead of command line args.

This Issue has been fixed in Release 1.0.1


feat: Temporary Files

Looks good. However, I have two comments:

I think it's better to have the field titles not abbreviated (Target Doctype instead of Target DT)
If you can please add minimal documentation of what each function does and a brief description of what the hourly scheduler will do.


Replace FBX C++/CLI importer with a cross-platform FBX library

** THIS IS A PLACEHOLDER ISSUE **
Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
Describe the solution you'd like
A clear and concise description of what you want to happen.
Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Additional context
Add any other context or screenshots about the feature request here.
Here are some questions that can aid in the description of the feature request:

What are the usecases?
What kind of options/settings are expected/wanted?
What would the (pseudo) code look like?
Is the feature affecting behaviour in the editor?

if so: how should this look in the editor?

Is there a component or datastructure?
what kind of documentation is needed or needs to be updated?
Should there be an example project?

I think Stride should copy Godot's model of encouraging glTF and using FBX2glTF to automatically convert imported FBX files.

What is the state of glTF support in Stride? Would this be an option?

gltf is already supported from what I know.
Also I had the project to move the fbx importer to uFBX but I was waiting for the transition to the new c++ build system to work on it

Based on #1030, it seems that glTF is not fully supported yet.
@SeleDreams Is there a reason you would prefer to maintain independent FBX importer support, instead of relying on FBX2glTF?


[Bug] Using BigQuery adapter, validation_errors - Invalid cast from STRING to JSON

Is there an existing issue for this?

[X] I have searched the existing issues

Describe the issue
First, thanks for the great work on these models!
When using BigQuery as the data warehouse for my data and running the XERO transform DBT models, there is one temp step that fails, causing the invoice line items model to be skipped.
The step is stg_xero__invoice_line_item_tmp and the error is in the following line:
cast('validation_errors' as JSON) as 'validation_errors'
(this ends up on line 26 of the rendered SQL in BQ, but for my use case, I am using multiple schemas to create a single set of output models)
The error being returned by BigQuery is the following:
Invalid cast from STRING to JSON at [111:26]

(again, the line numbers are likely specific to my project as I have multiple input schemas)

I noticed recently for the XERO connectors (and a few others) in Fivetran whilst using BigQuery as the destination that there was the following notification and wondered if the two were related?

I am unsure how to troubleshoot further and support where I can -
Relevant error log or model output
No models are output.

Errors as above in the description.

Final log status from the `dbt run` command as follows:

06:52:23  Completed with 1 error and 0 warnings:
06:52:23
06:52:23  Database Error in model stg_xero__invoice_line_item_tmp (models/tmp/stg_xero__invoice_line_item_tmp.sql)
06:52:23    Invalid cast from STRING to JSON at [111:26]
06:52:23    compiled Code at target/run/xero_source/models/tmp/stg_xero__invoice_line_item_tmp.sql

### Expected behavior

SQL is compiled appropriately and the [xero__invoice_line_items](https://github.com/fivetran/dbt_xero/blob/main/models/xero__invoice_line_items.sql) table is produced.

### dbt Project configurations

The following are the variables (obfuscated input schemas) in the `dbt_project.yml`:

```yaml
vars:
  xero_source:
    union_schemas: ['xero_xxxxxxx','xero_xxxxxxx','xero_xxxxxxx','xero_xxxxxxx','xero_xxxxxxx','xero_xxxxxxx','xero_xxxxxxx','xero_xxxxxxx','xero_xxxxxxx']

Using threads: 4 in the profile.
No other project specific vars or configurations are used.
Package versions
packages:
  - package: fivetran/xero
    version: [">=0.6.0", "<0.7.0"]

What database are you using dbt with?
bigquery
dbt Version
Core:
  - installed: 1.6.1
  - latest:    1.7.2 - Update available!

  Your version of dbt-core is out of date!
  You can find instructions for upgrading here:
  https://docs.getdbt.com/docs/installation

Plugins:
  - bigquery: 1.6.3 - Update available!

  At least one plugin is out of date or incompatible with dbt-core.
  You can find instructions for upgrading here:
  https://docs.getdbt.com/docs/installation

After attempting an update, I get the same issues with the following output from dbt --version
Core:
  - installed: 1.7.2
  - latest:    1.7.2 - Up to date!

Plugins:
  - bigquery: 1.7.2 - Up to date!

Additional Context
No response
Are you willing to open a PR to help address this issue?

[X] Yes.
[X] Yes, but I will need assistance and will schedule time during our office hours for guidance
[ ] No.

Hi @MatthewDaniels thank you for opening this issue. I am aware of this JSON BigQuery rollout; however, I wasn't aware that this would impact the Xero package as we do not perform any JSON parsing or JSON operations in the package.
It seems that this issue is a being caused by some of your Xero connectors that you are unioning have the validation_errors field in the source, while others do not. For your schemas that do have this field the datatype is now of type JSON, but the package is converting the schemas that don't have this field to be a string datatype. You can see the logic here.
However, when looking into this further I noticed we don't even bring this field into the downstream staging model (other any other downstream models). As a result, I believe the best fix here is to simply remove the field from the macro so it is not attempted to be unioned along with all the other fields being used in the package. Is this field crucial to any other analytics you are performing? If not, I would suggest we remove the field.
Here is a branch you may test out that removes the field. Let me know if this solves your immediate issue. If you do not have any immediate concerns with removing this field then we may take the next steps to roll this out in an official release.

Note: you will replace your official dbt hub package version in your packages.yml with the following to test the changes I mentioned above.

packages:
  - git: https://github.com/fivetran/dbt_xero.git
    revision: patch/json-union
    warn-unpinned: false

Let me know how this branch goes!

Thankyou so much for getting back to me so quickly on this - I really appreciate it and all the work that has gone into these packages!
Unfortunately I am facing the same issue after updating my package to use the patch branch (although have had partial success due to your explanation @fivetran-joemarkiewicz :+1: ) - perhaps I am missing something as I am fairly new to DBT (but not to coding / scripting / data engineering) - this also makes it difficult to step through the processes to debug myself (so any pointers would be massively welcomed!).
The steps I have followed are:

Update the package.yml
execute dbt deps
execute dbt run

I got the same error and the compiled SQL in the targets directory has the validation_errors still present in it for some reason.
I also then attempted to explicitly execute dbt clean - I understand dbt deps does this anyway, but thought I would try anyway. I also double checked that all the targets/ & the dbt_packages/ were removed for this step (of course they were!)
I also searched the dbt_packages/ folder for the validation_errors string to see where it appears (in an attempt to step through the processing). In the new patch branch it only appears in the docs, seeds, tests and one macro (but only as part of a column name has_validation_errors).

This is the contents of my packages.yml
packages:
  # - package: fivetran/xero
  #   version: [">=0.6.0", "<0.7.0"]
  - git: https://github.com/fivetran/dbt_xero.git
    revision: patch/json-union
    warn-unpinned: false

This is the contents of my package-lock.yml:
packages:
- git: https://github.com/fivetran/dbt_xero.git
  revision: patch/json-union
- git: https://github.com/fivetran/dbt_xero_source.git
  revision: patch/json-union
- package: fivetran/fivetran_utils
  version: 0.4.8
- package: dbt-labs/dbt_utils
  version: 1.1.1
sha1_hash: 69caaeb46e02a33fe81eefb9f7da1f5c2eac34e0

This is the last few lines of the CLI output:
22:58:25  Completed with 1 error and 0 warnings:
22:58:25
22:58:25    Database Error in model stg_xero__invoice_line_item_tmp (models/tmp/stg_xero__invoice_line_item_tmp.sql)
  Invalid cast from STRING to JSON at [111:26]
  compiled Code at target/run/xero_source/models/tmp/stg_xero__invoice_line_item_tmp.sql
22:58:25
22:58:25  Done. PASS=24 WARN=0 ERROR=1 SKIP=2 TOTAL=27

:100: Partial success
I tested with a SINGLE SCHEMA (ie: without the unioning, which as noted may include some of the errors) and I did not get the problem (likely because the single schema had no validation errors).
I then added back in some of the other schemas and have got it successfully working, but not with all the schemas I wanted to include.
I am super interested to understand why this patch may not have excluded the validation errors column altogether.

Hi @MatthewDaniels I am glad you are seeing partial success! 🎉 To get full success, can you try and also run dbt clean before rerunning dbt deps. This will reset your dbt_packages folder and ensure you are using the new patch version of the package.
If that doesn't work, I will take a deeper look to see if there is something else I need to adjust.

Hi @fivetran-joemarkiewicz, sorry I wasn't clear (or rather added likely too much info :smile: ) in my response (and thanks again for the super quick response!), but I did attempt to explicitly execute dbt clean - I understand dbt deps does this, but thought I would try anyway. I also double checked that all the targets/ & the dbt_packages/ folders / contents were removed for this step (of course they were!).
Both with no change to the compiled SQL, and unsure how to follow up from here, sorry!

Hi @MatthewDaniels thanks for adding the additional context. I was confused why removing the field did not seem to work. However, upon further investigation I found that the macro I changed in the patch is not actually the cause of the issue. Instead we can see that within the fivetran_utils.union_data macro that is called in the tmp models to union the data, we are calling the dbt_utils.union_relations() macro. This macro, inspects the source table and prepares all the fields to then be unioned across the various relations. At this point we have not done any field removing, this just unions the raw data synced by the Fivetran connectors.
In your case, it seems that some of your Xero connectors have received the JSON update while others have not, this results in the union_relations macro attempting to union the same field, but with differing datatypes. Thus resulting in the error you see.
I was able to reproduce this error locally and made an adjustment to the underlying union_data macro that then calls the dbt_utils.union_relations macro to include and excluded argument. This way we may then exclude this unnecessary validation_errors field from the unioning step performed in the package. Would you be able to attempt to rerun your project with these latest changes that I applied and let me know if this fully solves your issue?
Please note you will need to fully delete your  package-lock.yml filed and then run dbt clean, dbt deps, dbt run. I am unsure why, but when making these changes I noticed they were not picked up normally following a clean and deps unless I deleted and allowed dbt to regenerate the lock file. Let me know how this goes!
Ultimately, if this does solve the issue you are more than welcome to continue using this branch. However, I would encourage opening a support ticket and raising this datatype inconsistency to our support team to be addressed at the connector level. Thanks!

This is awesome insight, thanks heaps @fivetran-joemarkiewicz .
I can confirm that this worked with all of the schemas included! :tada:
With regards to the updating of the field to JSON in the Fivetran connector - I have found three of the 9 that have not been updated - one of which has not even synced in the last 6 months (so will need to fix that!). I think two of the sources have very little updates (if any) so perhaps Fivetran may not have completed the updates due to that?
At any rate - my DBT issue is resolved and I thank you so much for the help!

Thanks for sharing @MatthewDaniels! I am happy to hear that this patch resolved your immediate issue and that you will be able to work more closely with support to understand any updates that need to be applied to the connectors.
In the meantime, I will actually keep this issue open (but will mark as won't fix) for the time being in case any others run into the same issue you experienced.
Thanks again!


"Now" button does not update calendar selected date

Currently if you click the "Now" button once, the calendar selected date is not updated. Subsequent "Now" button clicks do update calendar selected date.

Should work in 1.5.3


Improve readability of Page reference / Scheduled Publishing

Page Scheduled Publishing docs docs are very hard to read because of the long wall of text. This PR breaks the text up using subheadings for easier scannability and readability. This aligns with the Google style guides
The second change (not shown in screenshots) makes the snippet scheduling note more visible, given its placement under a specific heading, users scanning the document would miss it if they don't read through the content under scheduled unpublishing. As a note it's more visible.
BEFORE

AFTER

Thanks for the screenshots also, makes it much easier to review the PR.


MQTT ESP32 setup

Hello. I have graduate project about IoT using with esp32. I need to setup mqtt broker with AT commands. I dont know which AT commands I should use. so Is there any document about it? I couldnt find can you help me please?

There are 3 blogs in Chinese, they may be helpful for you.

AT+MQTT overview: https://blog.csdn.net/espressif/article/details/101713780
Azure IoT: https://blog.csdn.net/espressif/article/details/103736743
AWS IoT: https://blog.csdn.net/espressif/article/details/101714951

AT+MQTTUSERCFG=,,<"client_id">,<"username">,<"password">,<cert_key_ID>,<CA_ID>,<"path">
I couldnt work it.

AT+MQTTUSERCFG=0,1,"","mrijxgpu","zPx3ho...",0,0,""\r\n
Can you say what is my client_id?

I see always ERROR return. Please help me

Whole mqtt command gives me error.

Please compile firmware using the latest master branch by yourself.
@ustccw

Thank you for help @xcguang But I have latest firmware

The latest release firmware does not support MQTT command. Currently you have to compile it by yourself. It will be enabled by default in the next release version.

When will you publish new release? And is there any document to compile it by myself? Then you can close. Thank you btw

If you use virtual box, you can try ubuntu1804.ova, which we have setup compile environment
Or you can try the bin artifacts-5.zip
I will close this issue, if you have any other question, please create new issue


Replace many uses of err with austral_raise

This reduces the total number of calls to Error.err from around 190 to a bit less than 50, replacing them with appropriate calls to austral_raise.
Although I've tried to not be too radical with the changes, I found that doing a simple "search and replace" ended up making the code quite noisy, especially in places where there are many longer error messages. As such, I ended up creating submodules named Errors in every module where an error is emitted. These submodules contain functions like Errors.unknown_typeclass : identifier -> 'a which take care of formatting and eventually raising the error.
For some of the updated calls, I also added some more information and tried to make the error messages a bit clearer and more helpful. Because some of the expected stderrs in the test suite had to be updated because of that, I only did so when I felt there was a significant enough improvement. None of the tests themselves have changed.
The remaining errs were left alone either because I was unable to trigger them and/or because I believed they should be internal_errs instead.
Finally, I have to the best of my knowledge only touched the error reporting stuff, so the compiler logic itself should be unaffected.

Reviewing now

Oh, this is really wonderful :pray:

Thanks so much!


looping on rows columns functionality

I've added a looping functionality on rows and columns, this will ease when scanning over a table for ex.
let the code talk :+1:
package main

import (
	"fmt"
	"github.com/NaySoftware/excelize"
	"os"
)

func main() {
	xlsx, err := excelize.OpenFile("WorkBook.xlsx")
	if err != nil {
		fmt.Println(err)
		os.Exit(1)
	}

	rows, err := xlsx.GetRows("Sheet1")
	if err != nil {
		fmt.Println(err)
	}

	for _, row := range rows {
		for _, colCell := range row.C {
			val, _ := colCell.GetValueFrom(xlsx)
			fmt.Print(val, "\t\t")
		} // cols
		fmt.Println()
	} // rows

	fmt.Println()
} // main

Current coverage is 80.41% (diff: 0.00%)

Merging #11 into master will decrease coverage by 11.16%

@@             master        #11   diff @@
==========================================
  Files             5          6     +1
  Lines           404        429    +25
  Methods           0          0
  Messages          0          0
  Branches          0          0
==========================================
- Hits            370        345    -25
- Misses           19         65    +46
- Partials         15         19     +4

Powered by Codecov. Last update 6185cd5...1bbc54d

Thanks for your PR. I found that some code will cause golint tips. I will update them later. I also found u have push some .xlsx files after tested, these excel file is useless and will decrease coverage. I will delete them.

Thanks for your PR. I found that some code will cause golint tips. I will update them later. I also found u have push some .xlsx files after tested, these excel file is useless and will decrease coverage. I will delete them.

I will update the code and make a new pull request


Numpy version conflict

I encountered with this error when installing dependencies in Colab.
Pls help me to check this, thanks!

ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
jax 0.4.14 requires numpy>=1.22, but you have numpy 1.21.6 which is incompatible.
jaxlib 0.4.14+cuda11.cudnn86 requires numpy>=1.22, but you have numpy 1.21.6 which is incompatible.
plotnine 0.12.3 requires numpy>=1.23.0, but you have numpy 1.21.6 which is incompatible.
tensorflow 2.13.0 requires numpy<=1.24.3,>=1.22, but you have numpy 1.21.6 which is incompatible.
Successfully installed addict-2.4.0 aiofiles-23.2.1 basicsr-1.4.2 dlib-19.24.0 einops-0.4.1 face-alignment-1.3.4 facexlib-0.2.5 fastapi-0.103.1 ffmpy-0.3.1 filterpy-1.4.5 gradio-3.44.4 gradio-client-0.5.1 h11-0.14.0 httpcore-0.18.0 httpx-0.25.0 huggingface-hub-0.17.2 kornia-0.5.1 librosa-0.9.2 lmdb-1.4.1 ninja-<IP_ADDRESS> numpy-1.21.6 orjson-3.9.7 pydub-0.25.1 python-multipart-0.0.6 resampy-0.4.2 semantic-version-2.10.0 starlette-0.27.0 tb-nightly-2.15.0a20230925 uvicorn-0.23.2 websockets-11.0.3 yapf-0.40.2
WARNING: The following packages were previously imported in this runtime:
  [numpy]
You must restart the runtime in order to use newly installed versions.

install  numpy==1.23.5

I always set requirements.txt without version numbers and then it adjusts the right ones by itself.
install numpy


check_syntax: data type simple

REPORT zfoobar.

CLASS lcl_test DEFINITION.
  PUBLIC SECTION.
    CLASS-METHODS test
      CHANGING
        cg_data TYPE simple.

ENDCLASS.
CLASS lcl_test IMPLEMENTATION.
  METHOD test.
    RETURN.
  ENDMETHOD.
ENDCLASS.

START-OF-SELECTION.

  DATA:
    BEGIN OF gs_data,
      key TYPE c LENGTH 1,
      val TYPE c LENGTH 10,
    END OF gs_data.

  lcl_test=>test( CHANGING cg_data = gs_data ).

/zfoobar.prog.abap[24, 3]: Method parameter type not compatible, CG_DATA(check_syntax)

simple also includes structures made of char-like types
https://help.sap.com/doc/abapdocu_latest_index_htm/latest/en-US/index.htm?file=abenbuilt_in_types_generic.htm

thanks, I'm on it, releasing new version in a bit

@mbtools try again, 2.91.1

👍


BulkTransferTest / LoopbackLarge and LoopbackMultiple fails

LoopbackLarge fails if the txBuf Size is > 4, i.e. starts at a size of 5.

/cib


"static site" handler

I'm willing to do the legwork on this feature, but wanted to get other folks' opinions first.
Motivation: I'd like to be able to write single-page applications that don't have their own servers, and are served directly out of perkeep. For example, right now I've got a janky feed reader written in Elm, with a Go server that has two responsibilities:

Serve the static files that constitute the web frontend.
Proxy the perkeep APIs.

It needs to do (2) because of CORS, otherwise the frontend could call out to perkeep directly. It's actually possible to skip this step now, if you're willing to punch this into your URL bar:
http://<perkeep-host&port>/ui/download/<blobref>/index.html
...assuming that you've got an html file that's entirely self-contained. But this isn't particularly usable.
What I'd like to see instead: I'd like to be able to put an entry in a low-level config like this:
"/feed-app/": {
    "handler": "static-site",
    "handlerArgs": {
        "camliRoot": "myapp",
    }
}

Then, I could "install" the app by copying the files into <fuse-filesystem>/roots/my-app.
Thoughts?

Another approach, which is much simpler to implement, but only covers the single file case: Just add a view fragment to the UI for html files; on top #1276 it would be a one-line patch. One addition I would probably want to add though is a filter that will only view documents of certain "dangerous" types if they're marked as "trusted", via some special attribute that could be set; otherwise I could see some nasty xss stuff happening with just adding text/html to that list.

i've wanted a handler for serving static SPAs for awhile, big +1 for that
the fragment thing is pretty loosy goosy as far as security and I doubt it would get merged, even with a guard attribute. I like data->code quines as much as the next mathematician pretending to be an engineer but thankfully there are others not of that ilk on this project :D
ps just noticed your recent activity, happy to see and I'll read through and respond where I have something to offer.

also yay Elm :D

I am working on this! I have been converging on a similar direction, but I was calling it an "app-server".
Ideally the ui handler is reduced to a simple auth mechanism and all other user interfaces run as such "apps" with a different handler on a different port (to leverage browser sandboxing) and request auth tokens from the ui handler which can give users a trusted UI to accept access from an app running from a specific blobRef.
But I would make it such that there is 1 "app-server" handler to configure, with no particular roots even. Any html file uploaded to perkeep can be an app basically. It's just that the iframe would load it from the app-server instead of from the ui handler.
This is all in a planning phase currently (because I am also grabbing a few other low hanging fruits first) but I'm improving on the approach bit by bit.
The plan is to extract the ServerConnection.js bits and reuse them in a new npm library, a perkeep.js ("perkapps" is a term I've been throwing around as well).

I 'm looking to use Hugo for "static site" generation [hugo is written in go].  I'm migrating ibm-portal to hugo.
However Hugo is missing CMS like UI.

a "non technical" editor for the Markdown files (won't trouble public service employees to think more)
and another UI page that mimics CMS workflow ..

Can your change provide such CMS like ui?

@anborg your comment is pretty off topic on the perkeep issue tracker. that said, a lot of ppl use a pull requests on a SCM host like Github or Gitlab for change management for static sites, with embedded edit links in each page. There's also https://stackedit.io/

I also thought this might be a nice addition, but I originally thought the functionality might make sense to merge with the existing publisher app (i.e. allow serving a template from a camliRoot rather than requiring the template to be served from disk as it currently works).
But instead of making that change, I took a stab at a simple static site handler as described here. The PR is at https://github.com/perkeep/perkeep/pull/1579. If anyone on this thread feels like testing it out, I'd appreciate any feedback.


[9.x] improve resolve method in cacheManger for early return.

"resolve" method of class CacheManager Refactored like as LogManager "resolve" method in early return pattern and remove some extra indent.

If this is not fixing a bug no plans to merge.


Update documentation

Change from XSSF to SXSSF
Document the breaking changes going to 1.0

The change from XSSF -> SXSSF
The change from Groovy 2.4 -> 2.5

Document how to manage the page size with the SXSSF workbook

@jameskleeh I'd like to help but I'm wondering about docs versioning. I guess it would be helpful to have separate docs for 0.4.x and 1.x versions, maybe just create stub for 1.0  for a start? I saw many libs manage versions through url path like /{versionNumber}/ and /current/ but I don't know how to implement it as I haven't wrote docs

@kortov I'll try to update the build to take that into account

@kortov Note that if you're willing to help out you can start working on this in your fork. I should have the build figured out relatively soon

@kortov I've updated the build so 0.4.x tags will publish to the docs url /0.4 and master tags will publish to the docs url /1.0

@jameskleeh  cool! :+1:
btw 0.4.4 is still not released due some errors?

@kortov No it did release. Not sure why the build hung https://bintray.com/schlogen/com.jameskleeh/excel-builder/0.4.4


Change tooltip text on mentions/unread

I had wanted to do this. Thank you!
Please check my comment.

@yuya-oc
Adressed your comment.
I also took the liberty to add another commit, improving the badge descriptions.


MongoDB array update from UI makes it null.

Updating a string array from UI, set the value to null instead of setting the updated array.

The bug was fixed in commit e0f1d80e53b9b82d972baf226c0dd09ad4f62ee1


[ Tests ] Fixed copy-paste error in the test

Motivation
Fixed copy-paste error in the test.
thanks to @lhotari  pointed out this mistake.
Modifications

Fixed copy-paste error in the test

@lhotari  PTAL


Failure to load service worker in Workbench (and possibly in Connect)

I used Workbench to generate a shinylive exported site, and viewed index.html using the Files pane. The request for shinylive-sw.js was redirected to the login page, because no cookies were attached to that request. I found this SO question asking about this behavior, with a clue that it only happens if the registration happens within <script type="module"> (???).
I'm wondering whether this might also be a problem with Connect--I know we've published these to Connect somehow but have we tried it with content permissions set to private?

We've encountered an error where the service worker fails to load for Shinylive content published on Posit Connect or our internal Github. We'd like to test out Shinylive content internally before making apps public. Our workaround has been to manually update the exported load-shinylive-sw.js, but it would be nice if our users didn't have to do that:
if ("serviceWorker" in navigator) {
  navigator.serviceWorker.register(serviceWorkerPath, { type: "module" }).then(() => console.log("Service Worker registered")).catch(() => console.log("Service Worker registration failed"));
  navigator.serviceWorker.ready.then(() => {
    if (!navigator.serviceWorker.controller) {
      window.location.reload();
    }
  });
  // add this line to ensure RSC registers the service worker
  navigator.serviceWorker.register("shinylive-sw.js");
}


Requiring Forms authentication to list/download packages

I'm trying to secure a gallery (both the user-visible website and the api) and will not be able to use windows authentication.  I'd like to limit package listing and download to the accounts that people can register for on the site.  I tried setting things up as forms authentication with the following configuration entry, but after filling in my account info on the /users/account/logon page and hitting submit, I get redirected back to the logon page.
<authentication mode="Forms">
  <forms loginUrl="/users/account/Logon"/>
</authentication>
<authorization>
  <deny users="?" />
</authorization>

From a quick look at the gallery code, the LogOn() method on AuthenticationController uses SignIn() as the method to take the posted information, which doesn't seem to play nicely with Forms authentication.  If I rename the SignIn() method to LogOn(), Forms authentication and requiring a logon works for the website, but api access (via the Visual Studio Extension) never prompts me to log-on, it just sits there spinning.
I haven't tracked down exactly what's going on with the Visual Studio Extension yet, but I wanted to check to see if there's an easier option to turn off anonymous listing/downloading of packages that I just didn't see documented before I dug into the issue further.

This issue has been stale for over a year (super bad on our side :( ). Since I see no traffic I assume you figured it out. If not please re-open

I would like to know if this is possible?

I don't think there is a way to make vs do it without authoring a credential provider, credential providers are not available to the public yet.
You could do a basic auth instead

Didn't read the whole thread :( we will get back with a sample

The gallery has not been implemented for this, but with some effort it can be added.
To prevent access to the website side of things (e.g. search/package details page, ...), add an[Authorize] attribute to the controller actions you wish to limit access to authenticated users.
To prevent access to the API, add an [Authorize] attribute to the OData controller classes. This will unfortunately redirect to the forms authentication URL, which the NuGet client won't like. To overcome that, you'll have to implement a basic authentication filter for Web API (e.g. http://stevescodingblog.co.uk/basic-authentication-with-asp-net-webapi/) and apply it to the OData controller classes as well. This attribute could make use of the AuthenticationService class to validate basic auth username/password.

@maartenba I'm trying to implement this into my solution, but am having some difficulty, mostly due to my unfamiliarity with ASP.NET.  When trying to list packages on my local NuGetGallery (after attempting these changes), nuget says

WARNING: Could not connect to the feed specified at 'https://nuget.localtest.me/api/v2'. Please verify that the package source (located in the Package Manager Settings) is valid and ensure your network connectivity.

Applying the [Authorize] attribute to website functions I want is simple enough, but my troubles come with implementing BasicAuthentication so that access to the API could be authenticated.
Firstly, I was wondering which classes in particular classes I should apply the filters to. Are the three OData classes in NuGetGallery.Controllers all? Or should I also include NuGetGallery.OData.NuGetODataController?
I used the blogpost you linked to, and changed
IPasswordTransform transform = DependencyResolver.Current.GetService<IPasswordTransform>();
IRepository<User> userRepository = DependencyResolver.Current.GetService<IRepository<User>>();

User user = userRepository.All(u => u.Username == username && u.PasswordHash == transform.Transform(password)).SingleOrDefault();

to
AuthenticationService auth = DependencyResolver.Current.GetService<AuthenticationService>();
var user = auth.Authenticate(username, password).Result.User;

If this sort of thing is something you think should be on SO instead, please let me know.

You could apply it to the base NuGetODataController so that the other OData classes inherit from it.
Regarding the SSL error: make sure to visit https://nuget.localtest.me in the browser and add the certificate to your trusted certificates. Not having this certificate trusted means VS will refuse connecting to it :)

@maartenba, I'm trying to implement this but having issues when connecting via VS Nuget package manager and Nuget command line utility. I don't see the authorisation header in Fiddler. So response is just a redirection to the login page. Any clue of what I have missed?

Sounds like IIS is hijacking the auth and redirecting to the login page.

Thanks for your reply. Below is the request and response I found in the Fiddler;

GET http://abc-win7-362:93/api/v2/FindPackagesById()?id='xunit.runner.visualstudio' HTTP/1.1
Accept: application/atom+xml, application/xml
user-agent: NuGet Client V3/<IP_ADDRESS> (Microsoft Windows NT 6.1.7601 Service Pack 1, VS Enterprise/14.0)
Host: abc-win7-362:93
Cookie: __RequestVerificationToken=0-z_T07xnqP5FdiVquuSDbxAX_LFmbj9GXyIHksPOwlC8L30jXOof4coTYp91dxDgp3331dJ66b4_6jGO4stOusNoXdJUGITdl2_YRPDqPw1
Accept-Encoding: gzip, deflate

HTTP/1.1 302 Found
Cache-Control: no-cache
Pragma: no-cache
Content-Type: text/html
Expires: -1
Location: http://abc-win7-362:93/users/account/LogOn?ReturnUrl=%2Fapi%2Fv2%2FFindPackagesById%2528%2529%3Fid%3D'xunit.runner.visualstudio'
Server: Microsoft-IIS/7.5
X-CorrelationId: 32cf7522-790b-45ad-9105-e3ee3aadcc38
WWW-Authenticate: ApiKey realm="tga-win7-362"
X-Frame-Options: deny
X-XSS-Protection: 1; mode=block
X-Content-Type-Options: nosniff
Strict-Transport-Security: max-age=31536000
Date: Mon, 15 Aug 2016 21:55:02 GMT
Content-Length: 78

An API key must be provided in the 'X-NuGet-ApiKey' header to use this service
Any idea by looking on this? Sorry if I'm asking a silly question. I'm little new to these .net authentication. Great help. Thanks.

Definitely Forms Auth kicking in and hijacking this. You may want to try and skip the redirect (e.g. https://gyorgybalassy.wordpress.com/2013/12/10/suppressing-forms-authentcation-redirects/)

Thanks, yeah that the the thing happening. But I tried the above suggestion by adding a global.asax file. but still it gets the same 302 response. I debug the code, owin response in ApplyResponseChallengeAsync() in ApiKeyAuthenticationHandler gets the correct status 401, after that its 302.

Definitely IIS hijacking the redirect. Can you check the ApiKeyAuthenticationHandler? We use an explicit 403 there to make the authentication trigger.

+++1
Incredible, can it really be true that 2016 nobody has a functioning NuGet Gallery WITH authentication running!?


Add to Rabby Wallet

Add superbridge to Rabby Wallet so it's easier to connect asap and bridge.

@Freedomfightersng do you mean add Rabby to the list of wallets supported by Superbridge? If so, this is already handled via Rainbowkit


Side-by-side emoji cause posts not to be rendered when served from Feeds

Describe the bug
When a post is present in a feed that contains two emojis side-by-side (e.g. 🧪🪲) - the post is not rendered in the client.
To Reproduce
Steps to reproduce the behavior:
Create a feed with the skeleton:
{
  "feed": [{
    "post": "at://did:plc:dfywxa4352ebrely4hdrt56i/app.bsky.feed.post/3jxjrzjz5zl2c"
  }, {
    "post": "at://did:plc:wjx2guv6s4u6bl6xg4krzc4b/app.bsky.feed.post/3jxjpyo6esc2m"
  }]
}

Load it as a custom feed, and open within the app - no posts will render, even though each post can be visited independently:

https://bsky.app/profile/dlevenstein.bsky.social/post/3jxjrzjz5zl2c
https://bsky.app/profile/bug-gwen.bsky.social/post/3jxjpyo6esc2m

Expected behavior
The posts render in the feed as they do from the Home page/other pages in the apps.
Screenshots
N/A (bug is 'no output' so it looks like an empty feed from the client)
Details

Platform: Desktop (Chrome) and iOS App
Platform version: Chrome 114.0.5735.90
App version: 1.30.0 (1)

https://bsky.app/profile/jcsalterego.bsky.social/post/3jxlnren37q2p
Jerry has worked it out here - it's the language filter stripping them out.

With the change to not use language auto-detection, this is no longer an issue.


Issues with larch module when installing xraylarch on anaconda

I have been trying to install xraylarch onto a separate environment in Anaconda and have been having a lot of trouble accessing the larch module. First, I installed xraylarch but when I called "larch" it did not detect the module at all.
I then tried installing the larch package itself into the environment; this also failed as python still could not access any of the functions in larch. I tried uninstalling xraylarch, Anaconda and reinstalling and these issues still seem to persist.
Has anyone encountered anything similar and has ideas on how to best proceed next?
One note is that, this installation process worked for me in the past; I had to get my computer rebooted and wiped for other issues. After my computer was revived, this installation process consistently fails for me.

@jellyfish1997 Please give more precise details of what you did to install.  For example, what version of Anaconda are you using, what commands did you use to install xraylarch, etc?    Do a)  "First, I installed xraylarch" and b ) "I then tried installing the larch package itself into the environment" mean different things to you?  I don't know what the difference would be.

@newville I removed the xraylarch environment and manually deleted any residual files to begin the process again. Here is what I did:

Open anaconda terminal and create a new environment: conda create -y --name xraylarch python=>3.11.5
Activate xraylarch
conda install -y -c conda-forge wxpython pymatgen scipy h5py matplotlib
pip install xraylarch
At this last step I get the following error:
running build_ext
building 'CifFile.StarScan' extension
error: Microsoft Visual C++ 14.0 or greater is required. Get it with "Microsoft C++ Build Tools": https://visualstudio.microsoft.com/visual-cpp-build-tools/
[end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for pycifrw
Failed to build pycifrw
ERROR: Could not build wheels for pycifrw, which is required to install pyproject.toml-based projects
I had also tried this installation simply using conda-forge. And in that case, I had a lot of issues getting the env\python.exe to run.

@jellyfish1997 One of the reasons we strongly recommend using the installer scripts is that these sorts of issues are easily avoided.   Sort of as a corollary, we sort of assume that someone choosing to use their own Anaconda environment would be able to do some troubleshooting about package installation.
I would guess that if you did
 conda install -y -c conda-forge  python==3.11.5 numpy scipy matplotlib h5py scikit-image scikit-learn pycifrw pandas jupyter plotly wxpython fabio pyfai pymatgen mkl_fft tomopy

pip install xraylarch[larix]

That everything would work.
Installing PyCIFrw with pip will try to automatically compile some C code, which can easily fail, especially on Windows.  Installing with conda or mamba avoids that.
Again, we strongly recommend using the installation scripts.

@newville maybe extra work in this way but I installed MS C++ tools and got the installation to work with some minor troubleshooting.


Multiple connections

Is it possible to make multiple connections to the input node?

It is possible currently in v3


Unknown host tools.stratio.com: unknown error

move nodeURL to node profile, to avoid usage of internal repo when needed  Fixes #1589

Coverage remained the same at 51.683% when pulling 9b034eaf4de256baf66f8e3944787d03e491d175 on antonioalf:nodeURL into 1419a0a2d8f65c886640332dedf5278848600afc on Stratio:master.


Many expressions in logical statement?

Hello,
I am working on a scheduling problem using CP. The behavior that I want is the following:
if at least one of a set of optional interval variables is present, then an integer variable is equal to 1.
If the 'set' was small I would explicitly write the constraint using the overloaded OR operator '|'. But the set is huge. I tried doing a loop:
for var in set:
expr += presenceOf(x) |
but this outputs an error. I also tried nested logical or to no avail. Is there a way to create the the logical statement
presenceOf(x1) | presenceOf(x2) | ... | presenceOf(x_n)
where 'n' is large?

Hello,
Would it be possible to share a code snippet to reproduce that issue ? What kind of error do you get ?
What is the value of a large n in your case ?
Otherwise, could you try something like:
mdl.add(mdl.any([mdl.presence_of(itv) for itv in set]) == IntegerVar)
Kind regards,

Hello @HuguesJuille ,
The interval variables I played with are from the house_building example https://github.com/IBMDecisionOptimization/docplex-examples/blob/master/examples/cp/visu/house_building_basic.py
My n for my real problem can be >= 300
The snippet I tried are:
sets = [masonry, facade, painting, roofing, plumbing, carpentry, ceiling] expr = 0 for itv_var in sets:     expr += presenceOf(x) |
This generates a syntax error because of the type (stupid but just wanted to try it). The next snippet is trying the nested logical_or:
sets = [facade, painting, roofing, plumbing, carpentry, ceiling] expr = logical_or(masonry,None) for itv_var in sets:     expr = logical_or(itv_var, expr)
And this generates a CPO expression can not be used as boolean. I actually found a solution after trial and error and I verified it via the exported model file. I tried
sets = [facade, painting, roofing, plumbing, carpentry, ceiling] mdl0.add(logical_or([presence_of(itv_var) for itv_var in sets]) == (IntegerVar==1))
Thanks,


WebSocketSharp dependency error on installing the nuget

Hello everyone,
I am trying to write a C# application to communicate with ROS. I get this error when I try to install RosSharpRosBridgeClient from NuGet manager UI:
Unable to resolve dependency 'WebSocketSharp'. Source(s) used: 'nuget.org', 'Microsoft Visual Studio Offline Packages'.
But when I install WebSocketSharp from the package manager console with the following code, it will work fine.
PM> Install-Package WebSocketSharp -Pre
Please either fix this or enlighten me if I am doing something wrong.
I use VS2019 and I have tried the installation with dotnet framework 4.6 & 4.6.1 & 4.7.2 & 4.8 versions.

Hi @robokamran , we could not reproduce this issue. We used the same sources nuget.org and Microsoft Visual Studio Offline Packages. Please make sure to use this nuget package:  https://www.nuget.org/packages/RosSharpRosBridgeClient/


Issue running migration against DB with sslmode=require

Running migrations against a --dsn that has ?sslmode=require (or with PGSSLMODE=require), I get:
ERROR:asyncio:Fatal error on SSL transport
protocol: <asyncio.sslproto.SSLProtocol object at 0x7f4882e35e20>
transport: <_SelectorSocketTransport closing fd=8>
Traceback (most recent call last):
  File "/opt/conda/lib/python3.8/asyncio/selector_events.py", line 910, in write
    n = self._sock.send(data)
OSError: [Errno 9] Bad file descriptor

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/opt/conda/lib/python3.8/asyncio/sslproto.py", line 685, in _process_write_backlog
    self._transport.write(chunk)
  File "/opt/conda/lib/python3.8/asyncio/selector_events.py", line 916, in write
    self._fatal_error(exc, 'Fatal write error on socket transport')
  File "/opt/conda/lib/python3.8/asyncio/selector_events.py", line 711, in _fatal_error
    self._force_close(exc)
  File "/opt/conda/lib/python3.8/asyncio/selector_events.py", line 723, in _force_close
    self._loop.call_soon(self._call_connection_lost, exc)
  File "/opt/conda/lib/python3.8/asyncio/base_events.py", line 719, in call_soon
    self._check_closed()
  File "/opt/conda/lib/python3.8/asyncio/base_events.py", line 508, in _check_closed
    raise RuntimeError('Event loop is closed')
RuntimeError: Event loop is closed

I'm able to connect to the database using the same dsn using psql. Any ideas?

.. It seems that pypgstac did run the migration, but perhaps this is an error that happens on closing?
I'm not seeing any of the logging output when running pypgstac migrate - perhaps that should be output another way?

Looks like this is related to https://github.com/MagicStack/asyncpg/issues/737

I think this might be fixed in asyncpg 2.3
https://github.com/MagicStack/asyncpg/pull/720
I'll try updating the asyncpg version pin.


Aggregation on multiple properties and schema changes

Got a couple issues that I've been spending some time with workarounds and want to make sure I'm not missing anything.  Am working with accumulo store, in case that is relevant.  If there is documentation somewhere that I'm missing that addresses these feel free to just point me to it, as I could easily have missed it.  Thanks!

I find myself sometimes wanting to aggregate a property based on other properties (not just the one I'm aggregating on), specifically based on the timestamp (ie. often something simple like grabbing the latest).  From a looking at the code I'm not sure a reason it couldn't be supported (at least in the accumulo case) but it didn't seem like it is.  Writing a schema i've found myself just wrapping the timestamp in the property so it's not that big of a deal, but adds some duplication and can prevent me from using something simple like a primitive type.

For my use-case I need to be flexible in allowing the creation of new types of elements.  Is there any documentation on migrating to a schema with an added element group?  Will simply providing a new schema at runtime with the new element group be an issue, or does it require an export/import to a new accumulo data store?  I can add the new type into a groupBy field instead of making it a element group, but seems a bit wrong to do so.

These aren't always issues, but on a couple element groups they are.

Hi,
For 1)
For the general case of aggregation of a property based on other properties that'll require a bit of thought on our end, your right it isn't currently supported.
Can you elaborate on your use case for this to help guide our thinking?
Just a thought based on what you've said so far,
If you've got a bunch of elements and just want to aggregate a property based on the "latest" value
If you don't change your groupBy at query time, then you can use the first bifunction https://github.com/gchq/koryphe/blob/master/src/main/java/uk/gov/gchq/koryphe/impl/binaryoperator/First.java
As in Accumulo at least, the elements will be sorted latest->oldest for each element id & groupBy (If you've put the timestamp in the Accumulo timestamp column)
For 2)
The good news is You can be flexible in allowing new element groups to be created and you don't need to do any import/export to/from tables, bad news you still do need to do a little work,
Once you have your updated schema, all you need to do is update the Accumulo table's iterators with the new schema's.
And We have a utility for this
https://github.com/gchq/Gaffer/blob/master/store-implementation/accumulo-store/src/main/java/uk/gov/gchq/gaffer/accumulostore/utils/AddUpdateTableIterator.java
You need to provide a comma separated list of schema file paths,  a store Properties file path and the argument: update.
You can do this programatically through the class by calling main method with the above arguments.
Admittedly It's not the most publicly facing API at the moment, we've had some other thoughts around storing schema's in some kind of central location - which could also then make it much simpler to update them on the stores. But we've not really looked at this too much.

for #1 - Unfortunately I can't go into the specific use-case.  In general the issue arises when there are a subset of the properties that are metadata about the element which can be used to determine how many of the other properties are to be aggregated. One example is timestamp but there can be others.  The non-timestamp properties will be in the schema's groupBy so that the data is not lost and can be queried on if necessary.  However there are many times we don't want to query on the metadata, but rather just want it used to provide the aggregated results of the non-metadata properties.  Hope that helps.  This can all be solved by bundling the metadata properties into each non-metdata property whos aggregation it affects, however it would be nice if that wasn't the necessary.  Thanks for pointing me to the First operator, as it would make sense to use that in situations where we will not change the groupBy and just need the timestamp for aggregation.
for #2 - In general, what are the limitations on what can change in the schema when using the AddUpdateTableIterator class?  The comments say you can change the validationFunction and the aggregateFunction, and you mentioned you can add an element group.  That makes sense that it would be just an iterator change.  Specifically, would there be any issues in me adding a new property (whether groupBy or not) to an existing element group?  I understand that something like changing the groupBy list on an existing element group would likely require me writing a map-reduce job or an export/import of some kind.
Thanks!

Also, apologies for creating 2 unrelated issues/questions in one issue.

Wrt First biFunction, since visibilities are treated similar to a removed groupBy in accumulo at query time, the function could produce incorrect results even if I'm not explicitly overriding the groupBy in my query.

1 - When we write the Koryphe library to handle the aggregation/filtering we thought about allowing multiple properties to be passed to a single aggregator function. It adds additional complexity and we didn't have a use case for it so we chose just to implement the basics initially. With validation and filtering we allow multiple properties to be passed to a Predicate by using KoryphePredicate2, KoryphePredicate3, etc. So, we could follow this same pattern create similar classes for aggregating multiple properties. I'll open up a separate issue and put some more information in that issue to describe how it would work.
2 - Ah sorry, yes we are missing a 'migration' section in the Accumulo Store README. I'll create a separate issue to add some documentation for that. In the meantime... here are the limitations:
You can do the following:

add new groups
add new non-groupBy properties (including visibility and timestamp), but they must go after the other properties
rename properties
change aggregators
change validators
change descriptions

You cannot do the following:

rename groups
remove any properties (groupBy, non-groupBy, visibility or timestamp)
add new groupBy properties
reorder any of the properties. In the Accumulo store we don't use any property names, we just rely on the order the properties are defined in the schema.
change the way properties or vertices are serialised - i.e don't change the serialisers.
change which properties are groupBy

Please note, that the validation functions in the schema can be a bit dangerous. If an element is found to be invalid then the element will be permanently deleted from the table. So, be very careful when making changes to your schema that you don't accidentally make all your existing elements invalid as you will quickly realise all your data has been deleted. For example, if you add a new property 'prop1' and set the validateFunctions to be a single Exists predicate. Then when that Exists predicate is applied to all of your existing elements, those old elements will fail validation and be removed.
If you have existing data, then before doing any form of upgrade or change to your table I would strongly recommend using the accumulo shell to clone the table so you have a backup so you can easily restore to that version if things go wrong. Even if you have an error like the one above where all your data is deleted in your table you will still be able to quickly revert back to your backup. Cloning a table in Accumulo is very simple and fast (it doesn't actually copy the data). If you have a table called 'table1', you can do something like the following in the Accumulo shell
> offline -t table1
> clone table1 table1-backup
> offline -t table1-backup

#Do you upgrades
# - deploy new gaffer jars to accumulo
# - run the AddUpdateTableIterator class to update table1

> online -t table1

# Check table1 is still healthy, run a query and check the iterators are successfully aggregating and filtering elements correctly.

> droptable -t table1-backup

I'll close this issue since others have been created.

If no one else needs to aggregate on multiple properties and since it's also probably never a blocker, I don't think it's a high priority.  Especially if it complicates the schema config.  If I have time to write it and think of a way to do it cleanly I'll throw up a pr to have you all look at it.

Adding the info you both just provided on accumulo table migrations is very helpful, thanks.  I'm sure others will find it very useful in the readme.


diffoscope: fix broken build due to cbfs tests for now

See: https://github.com/NixOS/nixpkgs/issues/256896
Description of changes

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
23.11 Release Notes (or backporting 23.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[ ] Fits CONTRIBUTING.md.

Result of nixpkgs-review pr 257635 run on x86_64-linux 1

6 packages built:

diffoscope
diffoscope.dist
diffoscope.man
diffoscopeMinimal
diffoscopeMinimal.dist
diffoscopeMinimal.man

@ofborg build diffoscope

Please edit your commit message to mention explicitly the reason for disabling as mentioning issues are not "durable" data. :)

Please edit your commit message to mention explicitly the reason for disabling as mentioning issues are not "durable" data. :)

Done, thanks.


Add BatchWriter

Thoughts @sagikazarmark @ddeboer ?

:+1: For extracting the batch writer functionality.
Some docblocks are missing, I guess it is WIP.
I also added some comments to the Flushable behavior and a possible risk I noticed in the code.

I like it, @Baachi. Please rebase on master. :wink:

:+1:

Merged into master.


Documentation Update: Feature Selection Profiles, Data Splitting, and Trained Models

This PR adds documentation on the different feature selection profiles generated, the data splitting approach, and the models trained in this study

Thanks now merging!


Fix secret name for openshift mode

Upgrading the gatekeeper causes cert-issue  due to the fact that the same secret name has been created by the service-ca already Ref: https://issues.redhat.com/browse/ACM-10859
Signed-off-by: yiraeChristineKim<EMAIL_ADDRESS>

Followup to:

#80

/cherrypick release-3.14

/cherrypick release-3.15


Split view and Blender unresponsive upon dragging window border in Blender on XPU mode enabled viewport render.

Can you see if you get the same problem if you use the dev branch?
https://github.com/prman-pixar/RenderManForBlender/tree/dev
I did fix an issue where it would stall if you resized the windows.

No response in almost two months. Closing.


Create and pass RNG, so that Global RNG is not reset

Fixes #20.

There are alternatives possible as well like f should always take one argument method and we create closures that keep track of rng instead. But won't work as easily with f_init and other usages of rand in the function.

@simon-lc pinging in case lost in CompatHelper PRs.

Or if I should make this PR on your personal github?


Convert resource files to binary on export

Feature request.
So .tres and .xml files (which are not PackedScene, as it's already handled) can get converted to binary on export like it's possible now with scenes.
If you inspect a packed game it's a bit ugly that the scenes are in binary but .tres files are still plain text.

How is this issue going with export changes on master?

Bumping for interest. What are the current state of things regarding this?

First of all thank you for your report and sorry for the delay.
We released Godot 3.0 in January 2018 after 18 months of work, fixing many old issues either directly, or by obsoleting/replacing the features they were referring to.
We still have hundreds of issues whose relevance/reproducibility needs to be checked against the current stable version, and that's where you can help us.
Could you check if the issue that you described initially is still relevant/reproducible in Godot 3.0 or any newer version, and comment about it here?
For bug reports, please also make sure that the issue contains detailed steps to reproduce the bug and, if possible, a zipped project that can be used to reproduce it right away. This greatly speeds up debugging and bugfixing tasks for our contributors.
Our Bugsquad will review this issue more in-depth in 15 days, and potentially close it if its relevance could not be confirmed.
Thanks in advance.
Note: This message is being copy-pasted to many "stale" issues (90+ days without activity). It might happen that it is not meaningful for this specific issue or appears oblivious of the issue's context, if so please comment to notify the Bugsquad about it.

This issue is still relevant, as the tscn files are still present in plain text.
To reproduce, export your project to Linux, and open the pck file with any text editor.

Duplicate of https://github.com/godotengine/godot/issues/6709

Since #12452 is already milestoned. I'll close this one. Thank you! :)


fix(slug): separate variable name and dimensions by __

Separating by __ (double underscore) the dimensions so that they can be differentiated from metric/dimension names.

This is solved by #323


NIFI-10780 Improve ListenSyslog and ListenTCP Event Queuing

Summary
NIFI-10780 Improves ListenSyslog and ListenTCP handling of queued messages when reaching the maximum configured queue size. Changes to the supporting ByteArrayMessageChannelHandler allow the handler to retry queuing messages as long as the Processor is running.
The changes update ByteArrayMessageChannelHandler to call BlockingQueue.offer() with a 500 ms timeout, instead of BlockingQueue.add(), which throws an IllegalStateException when attempt to add to a full queue. The handler loop checks the shutting down status of the managing EventExecutor to stop trying and throw an exception when the framework instructs the Processor to shutdown the listening event server.
Additional changes include adjusting the NettyEventServer to call ChannelFuture.await() instead of ChannelFuture.syncUninterruptibly() for the Channel.close() operation. This is necessary so that the shutdown() method proceeds to call shutdownGracefully(), which informs handlers that the executor is shutting down.
Queue failures can occur when the Processor is being stopped, the queue is full, and the listening event server is attempting to add a message to the queue. This scenario will result in throwing a new EventDroppedException, logged at the warning level.
Tracking
Please complete the following tracking steps prior to pull request creation.
Issue Tracking

[X] Apache NiFi Jira issue created

Pull Request Tracking

[X] Pull Request title starts with Apache NiFi Jira issue number, such as NIFI-00000
[X] Pull Request commit message starts with Apache NiFi Jira issue number, as such NIFI-00000

Pull Request Formatting

[X] Pull Request based on current revision of the main branch
[X] Pull Request refers to a feature branch with one commit containing changes

Verification
Please indicate the verification steps performed prior to pull request creation.
Build

[X] Build completed using mvn clean install -P contrib-check

[X] JDK 8
[X] JDK 11
[X] JDK 17

Licensing

[ ] New dependencies are compatible with the Apache License 2.0 according to the License Policy
[ ] New dependencies are documented in applicable LICENSE and NOTICE files

Documentation

[ ] Documentation formatting appears as expected in rendered files

Tested ListenTCP and ListenSyslog and found them to be in good working order. I did experience an 'EventDroppedException' when stopping the processor at some point. I also did a simple performance test and found that on my machine with a single thread, ListenSyslog could read about 2M short messages per 5m, and ListenTCP could read about 1.2m short messages per 5m.
For ListenTCP, single threaded, when sending 1MB messages I'm getting around 290MB throughput.
Functionally it looks good, I don't know if any of the changes would have affected performance but thought I'd check it out.

Thanks for the thorough review and performance testing @thenatog!
The EventDroppedException is expected when stopping the Processor prior to reading all of the events on to the FlowFile queue.
Performance will vary based on a variety of factors, such as concurrent tasks and batch size, but those are helpful references.

Sounds good, +1 will merge.


Supabase Fixes - Edge Functions and Email Redirect

Hi, I made some improvements!

Supabase edge functions are now correctly routed
GOTRUE_SITE_URL should be SERVICE_SITE_URL for correct redirect urls in emails
Fixed issue related to DB_AFTER_CONNECT_QUERY value will be incorrectly resolved if it's inside quotes
Update image versions

Thanks for the PR! :)


Set Svelte 4.x as peerDependency in package.json

Reverted from 4.x to 3.x in https://github.com/fmaclen/svelte-currency-input/pull/70
Making this change means that we can no longer support types in Svelte 3.x which would be a breaking change.

Or maybe not. peerDependency was set by the SvelteKit skeleton package generator. I added it this project here, but then it caused issues.
This was later removed and so far it has not been a problem.
The library doesn't require (so far) any specific versions of Svelte so demanding a specific version as a peer dependency doesn't seem to be worth it.


Update cassandra package version and reduce default consumed resources.

@ConnorDoyle @air please review and merge.

rebased and squashed.


Spec URL previews

Addresses the current state of affairs. This does not include the extra behaviour described in https://github.com/matrix-org/matrix-doc/issues/674
This also addresses https://github.com/matrix-org/matrix-doc/issues/1046

matrixbot: ok to test

\o/


fixing MacroCompiler, context and arguments aren't merged

#96
Ref.: https://github.com/twigphp/Twig/blob/v1.16.2/lib/Twig/Node/Macro.php#L55 (more readable logic)

Oooh this sure sounds like it could be a bug fix. Is it? What sort of circumstances does this bug happen in? What effects does it have?
If you could briefly explain some stuff about it, and I guess also include some kind of unit test or integration (or both, if you like) for the fix, this would be trivial to merge 👍

Don't quite remember the case, but iirc it was related to passing arguments to macro, before this PR they were ignored.

@hnrysmth can you take a look?