[Bug]: show "stylish" output

What happened?
In https://github.com/aspect-build/rules_lint/pull/140 I changed the formatter for eslint to the "compact" format, with reasoning explained in the PR.
However the stylish output is nicer for human-readability. Other linters have the same problem to a greater extent (perhaps tflint for example). The "machine-readable" output that https://github.com/reviewdog/errorformat can parse (e.g. for the editor to make the line:column clickable) is not nearly as nice as "human-readable" output.
Version
HEAD
How to reproduce
No response
Any other information?
Proposal is to add a flag like --@aspect_rules_lint//lint:output-machine-readable which tells any linter implementation that is aware of it to produce a machine-readable output. That could be a "compact" format, or perhaps the linter produces SARIF format directly so that no futher parsing is needed.
Note, for compatibility with tools that already wrap rules_lint, we may want to have a different report filename in the machine-readable case so those tools can be conditional in how they parse the report file.

as another example, when Vale is run with --output=CLI it prints the diagnostic level, which users need to understand whether they configured their errors vs. warnings correctly
Lint results for //docs/platform:training/101/04-Phases:

docs/platform/training/101/04-Phases.md
 19:4    warning  'Bazel Evaluation Model'        Google.Headings
                  should use sentence-style
                  capitalization.
 22:90   warning  Avoid using 'will'.             Google.Will
 25:11   error    Did you really mean             Vale.Spelling
                  'pipelined'?
 28:82   error    Did you really mean 'Skymeld'?  Vale.Spelling
 31:1    error    Commas and periods go inside    Google.Quotes
                  quotation marks.
 33:4    warning  Try to avoid using              Google.We
                  first-person plural like
                  'our'.
 33:13   warning  Try to avoid using              Google.We
                  first-person plural like 'we'.
 33:16   warning  Avoid using 'will'.             Google.Will
 37:24   warning  Try to avoid using              Google.We
                  first-person plural like 'we'.
 40:85   error    Did you really mean             Vale.Spelling
                  'autogazelle'?
 42:1    error    Commas and periods go inside    Google.Quotes
                  quotation marks.
 50:96   error    Don't use exclamation points    Google.Exclamation
                  in text.
 62:1    error    Commas and periods go inside    Google.Quotes
                  quotation marks.
 64:38   warning  Avoid using 'will'.             Google.Will
 74:1    warning  Try to avoid using              Google.We
                  first-person plural like 'We'.
 74:4    warning  Avoid using 'will'.             Google.Will
 76:5    warning  'Configure Phase' should use    Google.Headings
                  sentence-style capitalization.
 82:5    warning  'Fetching Phase' should use     Google.Headings
                  sentence-style capitalization.
 100:47  error    Did you really mean 'Wifi'?     Vale.Spelling
 114:1   warning  ': A' should be in lowercase.   Google.Colons
 119:1   warning  Try to avoid using              Google.We
                  first-person plural like 'We'.
 121:38  error    Did you really mean 'zlib'?     Vale.Spelling
 121:70  warning  Try to avoid using              Google.We
                  first-person plural like
                  'our'.
 121:79  warning  Use 'app' instead of            Google.WordList
                  'application'.
 128:59  warning  Avoid using 'will'.             Google.Will
 130:45  warning  Try to avoid using              Google.We
                  first-person plural like 'we'.
 132:14  warning  Try to avoid using              Google.We
                  first-person plural like 'we'.
 136:9   warning  Try to avoid using              Google.We
                  first-person plural like 'we'.

✖ 9 errors, 19 warnings and 0 suggestions in 1 file.

However currently we use --output=line with Vale to make it machine-parseable, and so we lose the severity.


Implementation details: Current Dataloader and Dataset class supports only static images.

Firstly, thanks for sharing the code!
Quoting from the paper:
Training Data. The training data of TransTrack could be the same as most other tracking methods, in which two consecutive frames or two randomly selected frames from a short sequence are used as training samples. Furthermore, training data could also be the static image [45], where the adjacent frame is simulated by randomly scaling and trans- lating the static image.
I believe the highlighted method is how the data is being loaded.
Is there any advice/support on how to load the current frame and previous frame?
It would also be really helpful if you share some references if you do not have support for this method.
Also, did picking the consecutive frame affect the results in anyway.
Thanks in advance.

Hi~
We will support loading the current frame and previous frame in recent weeks.

Got it, thanks!

Hello,thanks for sharing the code!Do you support loading the current frame and previous frame now?


Genomics: Save organism param value and state across searches

Currently, parameter values are stored on a per-search scope. We want an exception for the organism param, so that it's value is stored across searches. Additionally, we want to store the state of the tree.

Implementation notes:

ParamValueStore operated per-search, so we will leave that as0-is
In QuestionStoreModule, add support for param-specific overrides for value storage
This will make it easy to remove the latter, if we decide we don't want it.


IRC leave invalid channels

I would like to see a feature where the IRC bot will automatically leave invalid IRC channel. The IRC server that I use forces new users to automatically join a helpdesk channel. The bot should detect itself joining a non-configured channel and just leave automatically.

Great, we're happy to accept pull requests.
Sounds like that'd be about five to ten lines of code, and a good start on valuable contributions to StarryPy!


Add comparison check

This check will warn if there's an alert rule that doesn't have any condition in it, which can cause it to always fire

Codecov Report

Merging #30 (8d10685) into main (2fa1e73) will decrease coverage by 0.02%.
The diff coverage is 75.86%.

@@            Coverage Diff             @@
##             main      #30      +/-   ##
==========================================
- Coverage   77.56%   77.53%   -0.03%
==========================================
  Files          53       55       +2
  Lines        2019     2048      +29
==========================================
+ Hits         1566     1588      +22
- Misses        366      372       +6
- Partials       87       88       +1

Impacted Files
Coverage Δ

internal/checks/base.go
100.00% <ø> (ø)

internal/config/comparison.go
12.50% <12.50%> (ø)

internal/checks/comparison.go
100.00% <100.00%> (ø)

internal/config/rule.go
60.44% <100.00%> (+0.90%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 2fa1e73...8d10685. Read the comment docs.


Order type: allow consumer to specify type of order to use

Fixes #220
Allow a consumer to pass --order_type to trade and sim, it specifies how to make orders. See the updated README.md for more info.

Could have updated conf-sample.js with c.order_type default value as well

@eigilb good point, updated.

According with gdax website the maximum taker fee is 0.25% and not 0.3%
https://www.gdax.com/fees/BTC-USD
https://www.gdax.com/fees/BTC-EUR

@vitorego there is no support for multiple fees at this time, so I took the maximum.

Ok. By the way, the simulation will include the fees on profit calculation?

@vitorego it should, yep. It uses engine.update which uses the same functions as I updated here https://github.com/carlos8f/zenbot/pull/233/files#diff-a41b519e7979a713e894ef8d1b3fe568R473

@DeviaVir I got very profitable simulations using short periods and low ema, however in live trading the outcome is not same, even is not profitable at all. I guess with maker type orders the live trading will become profitable on short periods an low ema.

@vitorego makes sense, in live trading and limit orders you have to deal with slippage and filling delays. With maker orders the sim will be more close to reality, but it will not be profitable on short periods and low ema (as that results in more trades, more trades results in more fees), I would actually suggest higher periods and higher EMA.

Question for those more knowledgeable than me on the subject: if we use market orders, should we be using a different buy and sell price? Assuming we're right now either above or below it to successfully be a market maker.

Maybe it's possible to take dynamic user fees from exchange, like Bitfinex - api.bitfinex.com/v1/account_infos?

@nedievas certainly a good idea, I created https://github.com/carlos8f/zenbot/issues/237

Currently running this in a live test, if it does what it's supposed to do I'll merge (unless anyone else has any objects, of course).

I know this pull request was already merged. But I got this idea of having a auto mode on the other type. The boy will start with taker orders (no fee) if the slippage goes over a configured value the bot will close the order using the maker type order. What do you think?


Question: Multiple Virtual Machines for Swarm and Consul set up

Hi,
How can I configure and run multiple VM hosts with dlite?
I would like to play with Swarm and Consul on my Mac.
Thanks and kind regards, Sophie

I think this is a job for Vagrant ;) https://www.vagrantup.com/

Or Docker Machine

corectl is also a good option for this since it lets you run a CoreOS cluster, which is a friendly environment for swarm.
unfortunately, any kind of multiple VM situation is out of scope for dlite. for now, at least. maybe someday in the future.


TypeError: Cannot set property 'animationDuration' of undefined

I want to override the animation duration with
RouterAutoscroll.animationDuration = 0;

but then I get the build error
TypeError: Cannot set property 'animationDuration' of undefined

Though I can set RouterAutoscroll.animationDuration manually later, but it's not defined when the page first loads.
Is this the expected behavior? Do I have to keep checking if it's defined with setInterval?
I'm using version 0.0.10 as I haven't upgraded to Meteor 1.2 yet, because of bugs with different packages.

I updated to 0.1.0, error is still occurring.

Thanks, we'll take a look as soon as we can.

I'm on Meteor 1.2 now, error still occures. I maintain an all-package structure like telescope. I api.use and api.imply the okgrow:router-autoscroll package in my lib package, then set RouterAutoscroll.animationDuration in my core package.
If I wrap it in Meteor.setTimeout, there is no error.

hey @fabyeah, I'm taking a look at this. Is your package public? I'm having trouble reproducing this

@kdanninger unfortunately not, I'll see if I can recreate the issue in a public project.

Ok thanks! @fabyeah; Looking forward to a repro.
What I've done so far diagnosing this issue so far:

I cloned latest Telescope Meteor version <IP_ADDRESS>
telescope-lib package includes okgrow:router-autoscroll already
Set animationDuration in a Meteor.startup() in a lib folder within that package
confirm that animationDurection has been set

@kdanninger oh god, I put it in a shared directory... because iron-router tells you to put your routes there.
Thanks for following up!
Closed.

Awesome! Glad you found it :+1:


Example files which run with the MAX485 TTL Module and the purple Soyo

For ESP32 and ESP8266 Wemos D1 Mini Pro GTN1000 and limit to 600W to fullfill law in case to much power would be pushed into grid.

Thanks for your contribution! Could you try to summarize the differences to the standard example as comment at the top of the YAMLs? IMO these details should be mentioned/specified:

This configuration is for silent Soyosource inverters which doesn't respond to status requests. Therefore no status informations like the operation mode are available and cannot be monitored. The monitoring of the operation mode is disabled.
The instantaneous power is extracted from a JSON response periodically retrieved via HTTP from a Shelly XYZ running firmware ABC.
The maximum power output and select entities are limited to 600W in order to not violate the regulations in germany.

Added comments as suggested

I would like to change same additional details. I'm allowed to change the examples at your main branch?

Sure you are allowed, feel free to adapt the changes.


fix: menu button icon alignment fixed.

Description

Menu Button right icon alignment was broken, this Pull Requests fixed it

Fixes #13745
Type of change

Bug fix (non-breaking change which fixes an issue)

How Has This Been Tested?

Tested Manually on the canvas

Checklist:

[ ] My code follows the style guidelines of this project
[ ] I have performed a self-review of my own code
[ ] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[ ] My changes generate no new warnings
[ ] I have added tests that prove my fix is effective or that my feature works
[ ] New and existing unit tests pass locally with my changes

/ok-to-test sha=26bcc34

/ok-to-test sha=9fa3b09

Tested this PR and working as expected


⚠ Bofrost.gr has degraded performance

In 126a010, Bofrost.gr (https://www.bofrost.gr) experienced degraded performance:

HTTP code: 200
Response time: 1673 ms

Resolved: Bofrost.gr performance has improved in e1e6f33.


Fix/stub methods

Description

Added stub methods in order to build the project
Checklist
The following items should be checked before the pull request can be merged.

[x] Code follows existing style.

Thank you for your contribution @Intybyte. This seems to be a duplicate of https://github.com/MockBukkit/MockBukkit/pull/1136. Given that you have already spent some time to this, could you leave your review on the PR? Thanks in advance!

Yeah i forgot to check, it wasn't building so i just made a pr on the fly


Warning:: command not found (some error in bashrc)

After I added this lines to my .bashrc
source /opt/phpbrew/.phpbrew/bashrc
like in Installating manual and relogin I've got this error:
Warning:: command not found
when login to ssh
OS: Ubuntu 15.04

Can you gist your env?
$ env

yes, here it is
phpbrew@web1:~$ env
LC_PAPER=ru_RU.UTF-8
XDG_SESSION_ID=37
LC_ADDRESS=ru_RU.UTF-8
LC_MONETARY=ru_RU.UTF-8
PHPBREW_BIN=/opt/phpbrew/.phpbrew/bin
PHPBREW_PATH=/opt/phpbrew/.phpbrew/php/php-7.0.4/bin
TERM=xterm
SHELL=/bin/bash
SSH_CLIENT=<IP_ADDRESS> 53133 22
PHPBREW_ROOT=/opt/phpbrew/.phpbrew
LC_NUMERIC=ru_RU.UTF-8
SSH_TTY=/dev/pts/0
USER=phpbrew
LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:.tar=01;31:.tgz=01;31:.arc=01;31:.arj=01;31:.taz=01;31:.lha=01;31:.lz4=01;31:.lzh=01;31:.lzma=01;31:.tlz=01;31:.txz=01;31:.tzo=01;31:.t7z=01;31:.zip=01;31:.z=01;31:.Z=01;31:.dz=01;31:.gz=01;31:.lrz=01;31:.lz=01;31:.lzo=01;31:.xz=01;31:.bz2=01;31:.bz=01;31:.tbz=01;31:.tbz2=01;31:.tz=01;31:.deb=01;31:.rpm=01;31:.jar=01;31:.war=01;31:.ear=01;31:.sar=01;31:.rar=01;31:.alz=01;31:.ace=01;31:.zoo=01;31:.cpio=01;31:.7z=01;31:.rz=01;31:.cab=01;31:.jpg=01;35:.jpeg=01;35:.gif=01;35:.bmp=01;35:.pbm=01;35:.pgm=01;35:.ppm=01;35:.tga=01;35:.xbm=01;35:.xpm=01;35:.tif=01;35:.tiff=01;35:.png=01;35:.svg=01;35:.svgz=01;35:.mng=01;35:.pcx=01;35:.mov=01;35:.mpg=01;35:.mpeg=01;35:.m2v=01;35:.mkv=01;35:.webm=01;35:.ogm=01;35:.mp4=01;35:.m4v=01;35:.mp4v=01;35:.vob=01;35:.qt=01;35:.nuv=01;35:.wmv=01;35:.asf=01;35:.rm=01;35:.rmvb=01;35:.flc=01;35:.avi=01;35:.fli=01;35:.flv=01;35:.gl=01;35:.dl=01;35:.xcf=01;35:.xwd=01;35:.yuv=01;35:.cgm=01;35:.emf=01;35:.axv=01;35:.anx=01;35:.ogv=01;35:.ogx=01;35:.aac=00;36:.au=00;36:.flac=00;36:.m4a=00;36:.mid=00;36:.midi=00;36:.mka=00;36:.mp3=00;36:.mpc=00;36:.ogg=00;36:.ra=00;36:.wav=00;36:.axa=00;36:.oga=00;36:.spx=00;36:.xspf=00;36:
LC_TELEPHONE=ru_RU.UTF-8
MAIL=/var/mail/phpbrew
PATH=/opt/phpbrew/.phpbrew/php/php-7.0.4/bin:/opt/phpbrew/.phpbrew/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games
PHPBREW_HOME=/opt/phpbrew/.phpbrew
LC_IDENTIFICATION=ru_RU.UTF-8
PHPBREW_VERSION_REGEX=^([[:digit:]]+.){2}[[:digit:]]+$
PWD=/opt/phpbrew
PHPBREW_LOOKUP_PREFIX=
LANG=en_US.UTF-8
PATH_WITHOUT_PHPBREW=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games
LC_MEASUREMENT=ru_RU.UTF-8
SHLVL=1
HOME=/opt/phpbrew
LANGUAGE=en_US:en
LOGNAME=phpbrew
SSH_CONNECTION=<IP_ADDRESS> 53133 <IP_ADDRESS> 22
LESSOPEN=| /usr/bin/lesspipe %s
PHPBREW_PHP=php-7.0.4
XDG_RUNTIME_DIR=/run/user/1001
LESSCLOSE=/usr/bin/lesspipe %s %s
LC_TIME=ru_RU.UTF-8
LC_NAME=ru_RU.UTF-8
_=/usr/bin/env

Similar issue, Source the phpbrew bashrc and terminal has no idea where to find commands.

This is really weird. not sure what kind of the command it's looking for.

Hi @netandreus, @indiealexh
Please help us verify this fix when you have some time to try the fix. :) It should be fixed in 86672c0e507b595c9b97bbaf7b24e38954ddf739
You can simply run phpbrew self-update

I think this is really weird, I created a new aws instance with ubuntu 15.04, installed phpbrew requirements and then install phpbrew, I didn't see any "command not found" related message

I had the same issue, and I successfully solved it.
My last operations with phpbrew:

failed attempt to install php 5.2 on ubuntu 14.04 LTS
some attempts to enable and install the pdo_mysql extension.
phpbrew clean php-5.4.45 and then phpbrew install 5.4 +default +mysql +pdo +debug
phpbrew clean php-7.0.7 and then phpbrew install 7.0 +default +mysql +pdo +debug

After these, this is the content of my ~/.phpbrew/init:
# DO NOT EDIT THIS FILE

Warning: Module 'pdo_mysql' already loaded in Unknown on line 0
export PHPBREW_ROOT=/home/me/.phpbrew
export PHPBREW_HOME=/home/me/.phpbrew
export PHPBREW_LOOKUP_PREFIX=
export PHPBREW_PHP=php-5.4.45
export PHPBREW_PATH=/home/me/.phpbrew/php/php-5.4.45/bin
# Run this command to configure your shell:
# # eval "$(phpbrew env)"

The problem was the 3rd line. Removing it everything works.

Have the same issue, and I type sudo vi ~/.phpbrew/init found the PHP error messages were recorded in it

I remove them and works fine .

it seems to be a duplicate of #742 , and @c9s already fix it in 81d1c97f1228d58eb3725a3f75530a7b0c9463d1
@YamiOdymel what's your phpbrew version?

1.21.3, the latest one, I installed that last week.

Still happening in phpbrew 1.22.6. https://github.com/phpbrew/phpbrew/issues/694#issuecomment-227976409 is a temporal workaround.

@n4huel , could you paste your origin /opt/phpbrew/.phpbrew/bashrc here?

Closing due to lack of feedback.


Typedoc secondary entrypoints rendered on the docs hub

Summary
As part of the #2919 we added multiple entrypoints for typedocs. There are correctly not rendered as a navigation item within Vitepress, however, on the docs hub, these are being displayed as navigation items.

We should remove these items from being displayed as navigation items on the docs hub.

This should've been resolved by #2937. When was docs hub last updated?

I can see that it's not in the apps/docs/.typedoc/api-links.json. Potentially the docs-hub uses the directory contents for constructing these navigation items (so it's a docs-hub issue).
I'd favour isolating the API docs and referencing it, like what was discussed in sync.

I'd favour isolating the API docs and referencing it, like what was discussed in sync.

I agree as well, I think that would be the ideal solution rather than maintaining these API docs via a hacky postbuild script  it seems like misappropriated engineering resources in my opinion.

Added the following.
Would we want to close this or move the issue to the docs-hub?

Closed in favour of:

https://github.com/FuelLabs/fuels-ts/issues/3058.


HV: handle integral issues as MISRA-C report

mainly focus on: like U/UL as unsigned suffix;
char and int mix usage; also change some function's params
for data type consistent.
Signed-off-by: Minggui Cao<EMAIL_ADDRESS>Acked-by: Eddie Dong<EMAIL_ADDRESS>

wrong operation for my own master


gcc version

In yacl/base/int128.h,
#if __cplusplus >= 202002L
#else
constexpr int128_t abs(int128_t x) { return x >= 0 ? x : -x; }
#endif
I test it using gcc 12.2.0 with __cplusplus = 201703.  "int128_t abs(int128_t x)" is already written in stl.

Hi @maths644311798
The one in stl still missing constexpr, which is only required after c++23


settings[:gemfile] from .bundle/config file is not respected when doing require 'bundle/setup'

Gemfile configuration from .bundle/config is only respected when you use Bundler::CLI. Can someone tell me why, please?

Because Bundler resolves .bundle/config relative to the current Gemfile, so it needs to have a Gemfile first before looking up settings. You'll need to use $BUNDLE_GEMFILE if you want to control that path

Bundler resolves .bundle/config relative to the current Gemfile

No, it is being resolved relative to Dir.pwd and does not need a gemfile: https://github.com/bundler/bundler/blob/master/lib/bundler/shared_helpers.rb#L47
Does anyone mind me sharing this Bundler::CLI functionality with bundler/setup?

Personally, this sounds like something that could be fixed to me.

@faucct Did you end up trying my PR?

Yes: I didn't have the access to the project with the problem at that time anymore.

So, to confirm I understood (the initial "Yes" in your reply confused me), you were NOT able to try this PR and confirm it fixes the problem you had at the time, right?

Yes, you’ve got me right.


Issue with adapter for adminjs/mongoose

Contact Details
No response
What happened?
After starting application I receive this error: There are no adapters supporting one of the resource you provided.
I'm using @adminjs/mongoose adapter.
Bug prevalence
always
AdminJS dependencies version
"dependencies": {
"@adminjs/express": "^6.1.0",
"@adminjs/mongoose": "^4.1.0",
"@adminjs/nestjs": "^6.1.0",
"@nestjs/common": "^10.0.0",
"@nestjs/config": "^3.2.2",
"@nestjs/core": "^10.0.0",
"@nestjs/jwt": "^10.2.0",
"@nestjs/mongoose": "^10.0.6",
"@nestjs/passport": "^10.0.3",
"@nestjs/platform-express": "^10.0.0",
"@nestjs/throttler": "^5.2.0",
"@nestjs/typeorm": "^10.0.2",
"@types/nodemailer": "^6.4.15",
"@vercel/node": "^3.1.7",
"bcrypt": "^5.1.1",
"class-transformer": "^0.5.1",
"class-validator": "^0.14.1",
"compression": "^1.7.4",
"express-formidable": "^1.2.0",
"express-session": "^1.18.0",
"firebase-admin": "^12.2.0",
"handlebars": "^4.7.8",
"helmet": "^7.1.0",
"mongodb": "^5.9.2",
"mongoose": "^8.4.3",
"nanoid": "^3.3.7",
"nestjs-seeder": "^0.3.2",
"nodemailer": "^6.9.14",
"passport": "^0.7.0",
"passport-jwt": "^4.0.1",
"passport-local": "^1.0.0",
"reflect-metadata": "^0.2.0",
"rxjs": "^7.8.1",
"slugify": "^1.6.6",
"typeorm": "^0.3.20",
"zod": "^3.23.8"
},
"devDependencies": {
"@nestjs/cli": "^10.0.0",
"@nestjs/schematics": "^10.0.0",
"@nestjs/testing": "^10.3.10",
"@types/bcrypt": "^5.0.2",
"@types/express": "^4.17.17",
"@types/jest": "^29.5.2",
"@types/node": "^20.3.1",
"@types/passport-jwt": "^4.0.1",
"@types/passport-local": "^1.0.38",
"@types/supertest": "^6.0.0",
"@typescript-eslint/eslint-plugin": "^6.0.0",
"@typescript-eslint/parser": "^6.0.0",
"eslint": "^8.42.0",
"eslint-config-prettier": "^9.0.0",
"eslint-plugin-prettier": "^5.0.0",
"jest": "^29.5.0",
"prettier": "^3.0.0",
"source-map-support": "^0.5.21",
"supertest": "^6.3.3",
"ts-jest": "^29.1.0",
"ts-loader": "^9.4.3",
"ts-node": "^10.9.2",
"tsconfig-paths": "^4.2.0",
"typescript": "^5.1.3"
}
What browsers do you see the problem on?
Chrome
Relevant log output
NoResourceAdapterError: There are no adapters supporting one of the resource you provided
    at file:///*/*/*/*/*/node_modules/adminjs/lib/backend/utils/resources-factory/resources-factory.js:73:15

Relevant code that's giving you issues
Mongo schema:

import { Prop, Schema, SchemaFactory } from '@nestjs/mongoose';
import * as mongoose from 'mongoose';
import { Entity } from './entity.schema';
import { Document } from 'mongoose';
import { softDeletePlugin } from './soft_delete/soft-delete-plugin';

@Schema()
export class Appointment extends Document {
  @Prop({ type: mongoose.Schema.Types.ObjectId, ref: Entity.name })
  entity: Entity;
  @Prop({ type: Object, required: true })
  conversation_log: object;
}

export type AppointmentDocument = Appointment & Document;
const AppointmentSchema = SchemaFactory.createForClass(Appointment);

AppointmentSchema.plugin(softDeletePlugin);

export { AppointmentSchema };

App module:

import { Module } from '@nestjs/common';
import { MongooseModule } from '@nestjs/mongoose';
import { ConfigModule } from '@nestjs/config';
import * as process from 'process';
import { AppointmentsModule } from './appointments/appointments.module';
import { UsersModule } from './users/user.module';
import { AuthModule } from './auth/auth.module';
import { FilterModule } from './filters/filter.module';
import { EntitiesModule } from './entities/entities.module';
import { CitiesModule } from './cities/cities.module';
import { MailService } from './services/mail.service';
import { Appointment } from './schemas/appointment.schema';

export const dynamicImport = async (packageName: string) =>
  new Function(`return import('${packageName}')`)();

const DEFAULT_ADMIN = {
  email: '',
  password: '',
};

const authenticate = async (email: string, password: string) => {
  if (email === DEFAULT_ADMIN.email && password === DEFAULT_ADMIN.password) {
    return Promise.resolve(DEFAULT_ADMIN);
  }
  return null;
};

@Module({
  controllers: [],
  imports: [
    ConfigModule.forRoot({ isGlobal: true }),
    MongooseModule.forRootAsync({
      useFactory: async () => ({
        uri: process.env.DB_CONNECTION_URI,
      }),
    }),
    dynamicImport('@adminjs/nestjs').then(({ AdminModule }) =>
      AdminModule.createAdminAsync({
        useFactory: () => ({
          adminJsOptions: {
            rootPath: '/admin',
            resources: [Appointment],
          },
          auth: {
            authenticate,
            cookieName: '',
            cookiePassword: '',
          },
          sessionOptions: {
            resave: true,
            saveUninitialized: true,
            secret: 'secret',
          },
        }),
      }),
    ),
    AppointmentsModule,
    UsersModule,
    AuthModule,
    FilterModule,
    EntitiesModule,
    CitiesModule,
  ],
  providers: [MailService],
})
export class AppModule {}

I haven't used @nestjs/mongoose personally but if it returns different metadata than mongoose, it won't work and would require another adapter just for it.
However, you might be missing AdminJS.registerAdapter({ Database, Resource }) because I cannot find it in the code you shared.

Hey @dziraf, thank you for responding. I'm relatively new to nodejs. Can you please explain me what do you mean by mongoose. With what should I compare @nestjs/mongoose to?
Sorry, I didn't provide my main.ts, here is where I register the adapter.
import { NestFactory, Reflector } from '@nestjs/core';
import { AppModule, dynamicImport } from './app.module';
import helmet from 'helmet';
import { JwtAuthGuard } from './auth/guards/jwt.guard';
import * as admin from 'firebase-admin';

async function bootstrap() {
  const app = await NestFactory.create(AppModule);

  const reflector = app.get(Reflector);
  app.useGlobalGuards(new JwtAuthGuard(reflector));

  app.enableCors({ origin: '*' });
  app.use(helmet());

  const adminJSModule = await dynamicImport('adminjs');
  const AdminJS = adminJSModule.default;

  const AdminJSMongoose = await dynamicImport('@adminjs/mongoose');

  AdminJS.registerAdapter({
    Resource: AdminJSMongoose.Resource,
    Database: AdminJSMongoose.Database,
  });

  await app.listen(3000);
}
bootstrap();

  AdminJS.registerAdapter({
    Resource: AdminJSMongoose.Resource,
    Database: AdminJSMongoose.Database,
  });

Try placing that before bootstrap function or before const app = await .... Adapters have to be registered before AdminJS instance is created which is done at that step.

Can you please explain me what do you mean by mongoose. With what should I compare @nestjs/mongoose to?

Every adapter (@adminjs/mongoose, @adminjs/typeorm, etc) uses your ODM's/ORM's schemas/entitites to build AdminJS resources. mongoose is a MongoDB library which @adminjs/mongoose is integrated with. @nestjs/mongoose comes with it's own decorators and schema definition, so if resulting metadata is different to what mongoose returns, @adminjs/mongoose won't work with @nestjs/mongoose.

Greate, with AppointmentSchema it managed to register the adapter.
I have different error now:
TypeError: Cannot read properties of undefined (reading 'paths')     at Resource.properties (file:///Users/*/*/*/*/node_modules/@adminjs/mongoose/lib/resource.js:47:57)     at decorateDatabaseProperties (file:///Users/*/*/*/*/node_modules/adminjs/lib/backend/decorators/resource/utils/decorate-properties.js:9:19)
I have noticed another issue on this repo with exactly the same error. Did you manage to reproduce the error after pulling the repo.
Reference to the issue I'm talking about: #1257

Hello @dziraf,
I can't make it work, what ever I do.
I cloned example project and it doesn't work aswell.
Do you have any more suggestions?

Hey @dziraf,
I managed to make it work by exporting another class from my schema.ts
export class City extends Document
export type CityDocument = City & Document;
const CityModel = mongoose.model('City', CitySchema); //new
export { CitySchema, CityModel };
Now I have db connection problems, I assume that CityModel class doesn't have to do anything with db connection?
error:
Operation cities.find() buffering timed out after 10000ms


This looks interesting. Can u migrate this to textx-tools organization?

I want to learn more abt this repo and maybe work on it further myself. Thank you, @igordejanovic

Sure. Go ahead. This works together with https://github.com/textX-tools/textx-tools
I have't touched this in a long time so not sure how up-to-date it is but I would like the work on these tools to be resumed at some point as they are generally useful.
Our plan is to migrate everything under textX organization, even all the stuff currently under text-tools.
This will probably happen in the next few weeks.

BTW, thanks for your interest in textX and willing to work on it. :)

I'm motivated for my own selfish reasons.
I want to figure out if there's a way to write code faster as a team of one. DSL and metaprogramming techniques seem like a possibility.
but I am starting from ground zero and may require patience on your and other maintainers' end.
In return, I hope to put what I learn into the repo either as documentation or hopefully even outright code improvements.

Great!
I think most of DSL practitioners are in this field for the very same reasons. We try to find ways to make our job easier and be more productive. Usually a small team (even of one) is capable achieving performance of large teams using these techniques.
Well, I hope you will enjoy working with these tools as much as I do and make something out of it :)

I'll leave this open until the repo is migrated. Hope you okay with that :)

sure :)


Question about Nordland dataset.

Hi, thanks for your work. I have a question about Nordland dataset.
The Nordland dataset downloaded from [https://nrkbeta.no/2013/01/15/nordlandsbanen-minute-by-minute-season-by-season/]
is a video. What's frequency do you extract frames? Can you provide your related codes or used images dataset? Thanks.
Best regards.

Hi, we extract the frames at 1fps. We'll check whether we can provide access to the dataset directly.

Thanks for your reply.

Hello, are there any news on this topic?
It would be great to have the chance to download the dataset directly, as it would avoid possible inconsistencies.
Also, there shouldn't be any legal issue given that it is licensed under Creative Commons :-)


Updated brownie

Changes proposed in this PR:

updated brownie version

Closing this due to unwanted other commits on this branch. Created #1180 instead.


[DO NOT MERGE] remove async/await for now

Do not merge for now.
Diff is large b/c I executed cargo fmt. I'm going to draft a PR to format the repo properly first.
fixes #12

Can be rebased once #15 is merged


added comment to new code

Added into the file set-dataverse-aad-group-teams.yml to be able to specify what business unit the aad group team can be assigned to. The BU is hard coded but should be updated to pull the BU from a variable in the ALM Accelerator app settings.

@ryanhodgson1 thanks for submitting this. Looks like an obviously useful addition.
Would you mind opening an issue to track to this PR on
https://github.com/microsoft/coe-starter-kit/issues/new?assignees=&labels=alm-accelerator%2Cenhancement&template=4-alm-accelerator-feature.yml&title=[ALM+Accelerator+-+Feature]%3A+FEATURE+TITLE?

Thanks Mike
I have added the issue here: [ALM Accelerator - Feature]: Add option to select business unit for group teams · Issue #3393 · microsoft/coe-starter-kit (github.com)https://github.com/microsoft/coe-starter-kit/issues/3393
Ryan
From: Mike Ochs @.>
Sent: Wednesday, 10 August 2022 5:09 am
To: microsoft/coe-alm-accelerator-templates @.>
Cc: Ryan Hodgson @.>; Mention @.>
Subject: Re: [microsoft/coe-alm-accelerator-templates] added comment to new code (PR #162)
@ryanhodgson1https://github.com/ryanhodgson1 thanks for submitting this. Looks like an obviously useful addition.
Would you mind opening an issue to track to this PR on
https://github.com/microsoft/coe-starter-kit/issues/new?assignees=&labels=alm-accelerator%2Cenhancement&template=4-alm-accelerator-feature.yml&title=[ALM+Accelerator+-+Feature]%3A+FEATURE+TITLE?
—
Reply to this email directly, view it on GitHubhttps://github.com/microsoft/coe-alm-accelerator-templates/pull/162#issuecomment-1209645264, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ASQOCXOJ6DETZGPWSLMF7LTVYKGDVANCNFSM557JLTBQ.
You are receiving this because you were mentioned.Message ID<EMAIL_ADDRESS>

@ryanhodgson1 just wanted to update you on this. Haven't had a chance to review it yet. We're wrapping up on the September release right now, but I've added the issue you opened to the October release

Hey @ryanhodgson1 thanks again for submitting this. I've created a separate PR for this particular issue here https://github.com/microsoft/coe-alm-accelerator-templates/pull/191 based on changed we made in the app. Feel free to add your comments / suggestions there. Closing this out for now.


Adds combined gates for quadratic and cubic terms

Any thoughts on the gate names?

Tests passing now that OFC is synced with Cirq.

@kevinsung Is OFC dropping support for Python 2 as well? (That's the only failing test.)

Yes, we will be dropping Python 2 support.

Sorry for taking so long on this, it's mostly fine, I just don't really like the names ...

You don't like the new names?


_freebsd_install_usr_src() should ignore SCM data

It's pretty easy to overflow the memory disk used for prepping the image if you enable copying of /usr/src and it happens to have been fetched via git. Adding '--exclude .git' to the tar command worked for me, but the function should probably ignore other types of SCM data too.

This is a little tricky:  Personally, when I include /usr/src on an image, I want to be able to update it using the standard tools.  (Especially since doing a straight SVN checkout directly on RPi or Beaglebone is so very, very, very painful.  I would really appreciate if more people tried this and helped come up with ideas for how to fix the obvious problems.)
I suppose the only fix is probably to add an argument to control this.  Then we argue about which way should be default.  ;-)

I'll volunteer for doing the work.. It might be better to default to excluding the .$vcs dir..


[SPARK-31364][SQL][TESTS] Benchmark Parquet Nested Field Predicate Pushdown

What changes were proposed in this pull request?
This PR aims to add a benchmark suite for nested predicate pushdown with parquet file:
Performance comparison: Nested predicate pushdown disabled vs enabled,  with the following queries scenarios:

When predicate pushed down, parquet reader are able to filter out all the row groups without loading them.

When predicate pushed down, parquet reader only loads one of the row groups.

When predicate pushed down, parquet reader can't filter out any row group in order to see if we introduce too much overhead or not when enabling nested predicate push down.

Why are the changes needed?
No benchmark exists today for nested fields predicate pushdown performance evaluation.
Does this PR introduce any user-facing change?
No
How was this patch tested?
Benchmark runs and reporting result.

Can one of the admins verify this patch?

ok to test

Thank you for your first contribution, @JiJiTang .

cc @dbtsai , @holdenk , @gatorsmile

Can one of the admins verify this patch?

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/26377/
Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/26381/
Test PASSed.

ok to test

Test build #121702 has started for PR 28319 at commit 7a6df2c.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/26382/
Test PASSed.

Test build #121702 has finished for PR 28319 at commit 7a6df2c.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/121702/
Test PASSed.

cc @HyukjinKwon as well.

cc @MaxGekk

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/26453/
Test PASSed.

Thanks a lot @dbtsai , @cloud-fan. I have pushed a commit to fix coding style and rename the benchmark names. BTW do we have a IDE formatter config somewhere so that we can apply the formatting before pushing the commits?

Test build #121778 has started for PR 28319 at commit c72d0ce.

@dbtsai , @cloud-fan , just found that there's ./dev/scalafmt which can be used to format newly added code. Will use this to format the code.

Test build #121780 has started for PR 28319 at commit e0703a5.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/26455/
Test PASSed.

LGTM. Waiting for build.

Test build #121783 has started for PR 28319 at commit f275021.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/26458/
Test PASSed.

Merged into master / branch-3.0 Thanks!

@JiJiTang  do you have a apache jira account so I can assign this ticket to you?

Test build #121778 has finished for PR 28319 at commit c72d0ce.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/121778/
Test PASSed.

Test build #121780 has finished for PR 28319 at commit e0703a5.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/121780/
Test PASSed.

Test build #121783 has finished for PR 28319 at commit f275021.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/121783/
Test PASSed.

@dbtsai , thanks a lot. here you are my jira account : https://issues.apache.org/jira/secure/ViewProfile.jspa?name=jijitang

Thanks, @JiJiTang .
I added you to the Apache Spark contributor group and assigned SPARK-31364 to you.

Thanks a lot @dongjoon-hyun


Fix depwarn on 0.5 and 0.6

Coverage remained the same at 91.304% when pulling 6cd50fe2e39720450a031a54d1bcbe0914bf6747 on yuyichao:0.6-depwarn into 12d42a8e164bf0c6f8ad81f067461418a4ba5994 on tlycken:master.

Current coverage is 91.30% (diff: 0.00%)

No coverage report found for master at 12d42a8.

Powered by Codecov. Last update 12d42a8...6cd50fe

LGTM, thanks a lot!
(I've been afk for about a month, so I've completely missed the release of 0.5 with all that follows...)

TODO: Tag a release that includes this.
Ping me here if I haven't done this by the end of this week.


About the cryptonets-relu.pb

Could you provide the cryptonets-relu.pb file? Maybe effect the performence with a different. pb file.

I noticed that the it provided the file in utils/model.


Weekly Scrum (Week 4)

Team Member Updates: -
Each member answers:

What have I done this week?
What will I do next week?
What is holding me back?

Include Links:

Reference relevant issues or pull requests.

Added Integration Tests for Question https://github.com/adhambadawi/mini-survey-monkey/issues/14
Add More Testing for Multiple choice / Add anything else needed for final sprint
N/A

1- Created the integration tests for the survey controller, repository, and service #14 , and created the workflow for running all the integration tests as part of the deployment process with every merge that is made to the main branch. #41
2-  Further testing, and work on results compilation and display for the MCQs. Work on anything else needed for the final sprint.
3- Nothing at the moment

1- *Implemented survey closure mechanism related to issue #10
*Implemented survey reopen mechanism related to issue #32
*Implemented survey deletion mechanism related to issue #33
*Implemented Logout mechanism related to issue #30
2- Implement multiple choice feature, fix some bugs like enforcing the max and min values in range questions and limiting survey participation to logged in users only.
3- N/A

Integration testing for Response (#14)
Further testing, UI changes, and anything else related to final sprint.
N/A


Transitioning out of scene with does not use custom animationStyle

Version
Tell us which versions you are using:

react-native-router-flux v3.35.0
react-native v0.33

Expected behaviour
When using a scene with custom animationStyle prop, e.g.
<Scene key='Overview' component={Overview} panHandlers={null} animationStyle={myCustomHorizontal} />

I expect that animationStyle interpolation function to be used for transitioning in and out of the navigation card.
Actual behaviour
Only the transition to the card is using the custom animationStyle interpolation function, the transition out is using the default behaviour. This used to work in v3.34 (we downgraded to that version for now).
Steps to solve (maybe?)
Revert https://github.com/aksonov/react-native-router-flux/commit/04353d951ff88c35284c7e5baf73d19f79843a8e (Part of #1058)

I'm new to RN and I just found out how to set this for scenes and it is amazing. But my transitions back to previous scene are using default NavigationCardStack functions, which mess with the UX of my app.
@aksonov please consider this bug to be important for an update 🙏🏼

@peritus I realized it is not using default behavior, but using animationStyle of previous scene in the stack.
Let me explain: consider a base scene (A), on top of that I present a new scene (B) with custom animation style, as you explained, this scene will use that animation to push itself into the stack and when using panHandlers to animate a transition back, but when using pop() it will use default animation.
Let's say I push another scene on top of that (C) with another custom animation: it will use such animation to push itself and transition back with gestures, but at the time of using Actions.pop it uses B's animation.
That's why I conclude B is using A's animation to pop, which happens to be the default one.
I wish any collaborator or @aksonov would take a look into this 😕

Got the same issue.. Did a fix in router-flux to avoid it. DefaultRenderer.js in "RenderCard" method reads animationStyle from the wrong scene...

@Jlexyc Would you elaborate, please? Should animationStyle be read from props.scene.navigationState instead?

@wachunei i'm using:
 let panHandlers = selected.panHandlers;     let animationStyle = props.scene.navigationState.animationStyle
But there still an issue with transition. Like animation is called for both screens with different index. So i'm covering disappearing from old screen and appearing from new one.
But made it work in correct way. Animation of POP = reverse animation of PUSH for this screen.
Got one more issue with panHandlers:

Here myPan works everywhere... can't disable it on the rest scenes. Tried to write getPanHandlers for myComp1 only.. but in this case it doesn't work at all..

https://github.com/aksonov/react-native-router-flux/pull/1618/files


doc: improve documented examples (and remove generated images from the repo)

The generated images change on every build, which is unnecessarily time consuming!
Ignore them like you do the other build artefacts...

This is a documentation task: the examples ARE used in the README.md, but shouldn't reference anything in the library test folder.


Reorganize guide's navbar.

Closes #1022

@cdsmith this one is ready for you to review.

@Powell-v2
This code looks good, and I merged it.  However, while testing, I realized that saving the current help document position has been broken for a while.  Specifically, when the help window is closed, the parent does an iframe.contentWindow.savePosition(), has been failing because doc.js no longer adds savePosition function to the window object.  I've fixed that with a quick hack, but if there's a better answer, happy to do it that way.

I think it's alright to keep the function on the window object. Another option would be to communicate via postMessage().

Let's leave it as-is.  I thought about postMessage, but my concern is that since the window is being closed, an async message may not be received before the document is destroyed.  That could be worked around, but it seems tricky.  Let's leave it as is.


Automatically repull buildpack-deps

Proposed change
Make repo2docker automatically do a docker pull buildpack-deps:bionic when it first starts.
Recently we had issues building an image on a self-hosted binderhub when the image builds perfectly fine locally. The issue turns out to be a 14-month-old buildpack-deps:bionic image on the cluster, and repulling the image fixes this issue. Ideally, we should repull the image automatically in repo2docker.
Alternative options
Repull the image manually. This is fine for personal use (although sometimes users might forget), but is harder to do without manual intervention when running binder on a kubernetes cluster.
Who would use this feature?
Everyone who wants their image with up-to-date packages.
How much effort will adding it take?
Probably not too much, since the Python API already has a pull function. Also we should probably add a CLI option to disable this feature, but that won't take too much effort either.
Who can do this work?
I can, if people think adding this is a good idea. I'm not sure if there are any downsides to having this feature, so I'll wait for some feedback first.

Do you know why the base image changed? repo2docker assumes that rebuilding the same content (at the same revision) will lead to the same image. How true this is in practice depends a bit on how people configure their dependencies and if the base image can change "a lot" then we need to add that to the list of things that can break this promise. I was under the impression though that the base image (once released) would hardly change (in a way that is noticeable to the end user).
Always pulling the image is akin to using the image pull strategy off Always for kubernetes pods, which is not considered a  best practice (but popular with many people). Another thing that is hard to do is to decide when to pull the image. repo2docker "starts" every time a new build is triggered in a BinderHub, so on a moderately busy hub that means it starts every few minutes. Pulling the base image each time would make those builds pretty slow and increase bandwidth usage a lot without much benefit because most of the time the image would be the same.
I'd propose a rewording of the alternative: "Add instructions (in BinderHub) to manually remove the base image from the cluster for the cases where you know that the base image has changed in a meaningful way and needs re-pulling." I'd assume it is (very) rare that you have to do this. Maybe you can provide more details about what was broken/why the image needed re-pulling to help understand the situation and context you were in.

After some digging, the issue isn't related to buildpack-deps (it was due to binderhub using an old version of repo2docker by default, and the error message about pip not being able to upgrade some system packages led me to think that the old buildpack-deps was to blame, and I got confused because I was trying multiple things at once) and I'm sorry for assuming that. This issue can be closed if you don't think it's a problem.
From what I can tell, buildpack-deps is updated because sometimes the ubuntu packages are updated. It'll be nice to have (since otherwise some apt packages might be not up to date), but doesn't break anything since all the packages are still there.
I still think repulling buildpack-deps isn't that big of an problem, since if the image is up-to-date it should take less than a second as Docker figures out buildpack-deps is already up to date, but that's just a personal preference.


Difficulty Debugging the Vertex AI Training Pipeline

I am facing difficulties in debugging the Vertex AI training pipeline. The issue lies in the fact that I cannot run the pipeline locally for testing and debugging purposes. Instead, I have to submit the pipeline to Vertex AI and wait for it to execute in order to obtain debugging information.
The current debugging process involves sending the pipeline with multiple print statements or logging messages to trace the execution flow and pinpoint the exact location of the error. This becomes a slow and tedious cycle as it requires resubmitting the pipeline every time an adjustment or error identification is needed.
Steps to Reproduce the Problem:

Create a training pipeline in Vertex AI.
Submit the pipeline to Vertex AI for execution.
Wait for the pipeline to execute and retrieve the results.
Analyze the generated messages or logs to identify the error.
Make adjustments or corrections to the pipeline.
Repeat steps 2-5 until the problem is identified and resolved.

What would be the best way to handle this training component development cycle?

Hi @clopezhrimac, thanks for your question! KubeFlow limits the execution of pipelines locally, alternatives pointed by the community are:

creating a local kubernetes cluster and submitting your pipeline to the local cluster (instead of Vertex AI)
isolating individual KubeFlow operations into python- or container-based components to test your business logic locally, however, only for each component separately

In this project, we've optimised components to be inline with option (2). Commands which help you with testing locally are:
make setup-all-components
make test-all-components

or
make setup-component GROUP=<e.g. vertex-components>
make test-component GROUP=<e.g. vertex-components>

Further, we've replaced the python-based training component in the pipelines with a CustomTrainingJob recently which allows you to run your training script locally before submitting to Vertex AI.
While these don't provide full parity between local pipeline runs and submitting pipelines to Vertex AI, these will help you to iterate locally over any changes related to custom python-based components and your training code.
We're currently evaluating the use of CustomPythonPackageTrainingJob, too, and are open to any suggestions you might have!

What is the diference between CustomTrainingJob y CustomPythonPackageTrainingJob ?

Hi @clopezhrimac,
Thanks for this issue. Please check out the most recent PR and release.
We've moved away from CustomTrainingJob and CustomPythonPackageTrainingJob since KubeFlow 2.0 supports container components now.


move defaults out of template

define them as cookbook attributes
benefits:

business logic is out of template
attribute defaults can be overriden per role/environment

replaces: #30

please merge, i have bunch of other changes planned on top of this commit

+1 on this. It is really inexplicit to get default values rendered from the template logic. In Chef it's a common practice to use attribute files for that.

@yevgenko this cookbook is probably dead? i've trying to push this in since Dec 12, 2013 (#30)

Hey @glensc, sorry for late response and for ignoring project for awhile, I'll try to catch up with this.


Fix links in README

Signed-off-by: Ivan Milošević<EMAIL_ADDRESS>What does this do?
Fix links in README

Codecov Report

Merging #624 into ui will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##               ui     #624   +/-   ##
=======================================
  Coverage   86.86%   86.86%
=======================================
  Files          62       62
  Lines        3381     3381
=======================================
  Hits         2937     2937
  Misses        305      305
  Partials      139      139

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update ffb6931...4f94749. Read the comment docs.


Remove dependency on deep-equal

node.js has a built-in util.isDeepStrictEqual since v9.0.0: https://nodejs.org/docs/latest-v21.x/api/assert.html#assertdeepstrictequalactual-expected-message
This is helpful because the deep-equal package has 50 dependencies, mostly ponyfills. We can make supertape have 34% fewer dependencies and 18% less installed filesize just by using the built in function instead of the deep-equal package.
However, this change makes it go from a loosely equal comparison to a strictly equal comparison, which could affect people's tests. (I had to fix one of mine that was expecting null but actually got undefined.) So a major version bump to v11 will be required.

That's interesting idea! I should check this on my tests first, but yes we don't need any ponyfills since node v18 is the lowest version of node supported

Merged as ebb9d46. Landed in https://github.com/coderaiser/supertape/releases/tag/v10.4.0 🎉 .
Thank you!


How to use the repository within configuration.nix?

How can I use the repo directly?
let rustNightlyNixRepo = pkgs.fetchFromGitHub {
     owner = "solson";
     repo = "rust-nightly-nix";
     rev = "9e09d579431940367c1f6de9463944eef66de1d4";
     sha256 = "03zkjnzd13142yla52aqmgbbnmws7q8kn1l5nqaly22j31f125xy";
 };

I'd do s.th. like this:
let rustNightly = pkgs.callPackage "${rustNightlyNixRepo}/default.nix" { };

But that doesn't work :-\

...hmm, now it seems to work :) I don't know exactly why it didn't ;-)

note
let rustNightly = pkgs.callPackage rustNightlyNixRepo { };

will also work


DDL integration test is not stable

Bug Report
Please answer these questions before submitting your issue. Thanks!
1. Minimal reproduce step (Required)
[2023-10-27T08:46:48.364Z] fullstack-test2/ddl/alter_partition_by.test: Running

[2023-10-27T08:46:58.284Z]   File: fullstack-test2/ddl/alter_partition_by.test

[2023-10-27T08:46:58.284Z]   Error line: 171

[2023-10-27T08:46:58.284Z]   Error: select tidb_database,tidb_name from system.tables where tidb_database = 'test' and tidb_name = 't2' and is_tombstone = 0

[2023-10-27T08:46:58.284Z]   Result:

[2023-10-27T08:46:58.284Z]     <nothing>

[2023-10-27T08:46:58.284Z]   Expected:

[2023-10-27T08:46:58.284Z]     ┌─tidb_database─┬─tidb_name─┐

[2023-10-27T08:46:58.284Z]     │ test          │ t2        │

[2023-10-27T08:46:58.284Z]     └───────────────┴───────────┘

2. What did you expect to see? (Required)
3. What did you see instead (Required)
4. What is your TiFlash version? (Required)

https://ci.pingcap.net/blue/organizations/jenkins/tiflash-ghpr-integration-tests/detail/tiflash-ghpr-integration-tests/14874/pipeline/


OODtrack：the text2image1B/gt100-heldout.30K.fbin file seems fault

for the result it over 10000000 and can't use it to calculate recall
what's the problem?

above is the first ten results in the gt file

another problem is:
in the python run.py --neurips23track ood       --algorithm diskann --dataset random-xs, the distance is euclidean.
but in the python run.py --neurips23track ood       --algorithm diskann --dataset text2image-10M, the distance is ip,
which distance should i choose?

@harsha-simhadri @DmitryKey

Every dataset has its constant distance type.
In file benchmark/datasets.py, it contains all the datasets that this benchmark supports. The function "def distance(self)" return the distance type of a dataset.

Every dataset has its constant distance type. In file benchmark/datasets.py, it contains all the datasets that this benchmark supports. The function "def distance(self)" return the distance type of a dataset.

I just want to konw, why in the same track, the sample "random-xs" distance is different from "text2image-10M"

above is the first ten results in the gt file

maybe this is the "base_1B.fbin" gt file, for this, the organizer didn't provide the gt file of "text2image-10M"

random-xs is a very small dataset. random-xs could be used to quickly test the configuration of your alg is ok. the distance type of random-xs is irrelevant.

random-xs is a very small dataset. random-xs could be used to quickly test the configuration of your alg is ok. the distance type of random-xs is irrelevant.

ok, thx


Upgrade electron to 15 so we can use safeStorage

https://github.com/lbryio/lbry-desktop/pull/7384

@jessopb we can close this one :)


Release v2.28.0+rev1

@resin-jenkins test this please

Superseded by https://github.com/balena-os/balena-iot2000/pull/24


[WIP] [References] Reference order

Still a lot to do, will work on it later this week.

@Padam87 I know you were interested in helping reinvigorate this package. Is this still relevant to you?

Hello, and thank you for your contribution.
In the interest of spring cleaning and package modernization, I'm going through and closing old issues and pull requests that have had no recent activity, do not have associated tests, or have failing tests.
If you are still experiencing this issue or wish to contribute an up-to-date pull request, please create a new issue.
Thank you!


Fluid Framework support full page refresh on context reload

If possible, it might be nice if the host isolated only the runtime in an iframe, so that reload do cleanup easily without losing the Container.  If this is not feasible, it would still be good for the Fluid Framework to support full page refresh on context reload.
Currently it is not possible, because the old code will be loaded again, and the reload will happen again which would cause a loop.
Option 1: All clients block until summary ack
If the host/app/components prefer to do a full page refresh after a code proposal version upgrade, they need to block until the summarizer client sees the code proposal has been accepted, and then submits a summary which is acked.  This will prevent the clients from going through the proposal again and needing a refresh again (cycle).  It is important to make sure that we do not get stuck blocking forever- i.e. the summarize needs to succeed.
This option maximally leverages existing functionality and behavior.
Option 2: Container sniffs ops and loads latest code
Alternatively, the solution could be to provide some exposed info to the code loader or the code provider (if it is a shim) that would allow it to load the latest code proposal in the op stream rather than directly from the summary, and then bypass the code acceptance reload.
This may increase the critical path, since it requires the Container to connect to delta stream and scan ops before loading the code.  To mitigate this, it should be opt-in via a local storage flag or something.
Option 3: All clients race to summarize
Context reload already does an in-memory summary which is passed to the new runtime.  Instead of keeping this summary in-memory, it could be an actual summary which is posted.  Once any summary ack is seen (with ref seq > code proposal accepted seq), then all clients are free to refresh.  After refreshing, they will be loading from the latest code.
This method would pair with a change to have the summary that is created during reload be a "fast" or minimal work summary.  The snapshot would just be a pointer to the previous summary + a blob of the outstanding ops (quorum is server side, so that is fine).  This should increase speed at which the summary is created and decrease likelihood of failure.  It also makes it possible for summaries to be generated on "live" containers (vs. the separate summarizer container).
As a side-effect, there would likely be a blast of summary nack ops for all clients who didn't win the race to summarize.

this is related to #3478

@arinwt is this different from #1309

No it isn't different anymore. Originally it was to track some of the work you have been doing: the API for the host to refresh the page, etc. This was the earlier issue so it had more ideas in it before we had settled on race to summarize.


Add method to select sources/classifications for active learning

This PR adds a select_al_sample method to scope.py to select sources and their classifications from a collection of predictions and make an active learning sample. The method optionally removes sources in the current training set before selecting at random a user-specified minimum number of sources having classifications with probabilities ≥ a given probability threshold. The output is a dataset that can be posted to Fritz using scope_upload_classification.py.
One additional feature to consider is a fixed random state to allow reproducible active learning samples to be made from the same collection of predictions.

@mcoughlin I added a few lines to fix the random state for source selection. Seems beneficial to be able to reproduce the set of selected sources.

@bfhealy good idea! merge when ready.


Added Add2 method

:warning: Validation status: warnings

File
Status
Preview URL
Details

VBA/Excel-VBA/articles/sortfields-object-excel.md
:warning:Warning

Details

VBA/Excel-VBA/articles/sortfields-object-excel.md

Line 42: [Warning] Invalid file link:(~/Excel-VBA/articles/sortfields-add2-method-excel.md).

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.

:warning: Validation status: warnings

File
Status
Preview URL
Details

VBA/Excel-VBA/articles/sortfields-object-excel.md
:warning:Warning

Details

VBA/Excel-VBA/articles/sortfields-object-excel.md

Line 42: [Warning] Invalid file link:(~/Excel-VBA/articles/sortfields-add2-method-excel.md).

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Bump version to 8.4.1

Prep the repo to release 8.4.1 with the fix in #112.

Good idea. Added a mention of the fix from #100 to the changelog. Also merged #117 to ensure it gets included.


Don't fail when mmaps are exhausted

Description
With lots of fragments - especially when time quantums are being used, we see errors like creating fragment: opening fragment: opening storage: mmap: cannot allocate memory this could be due to the actual memory available being insufficient, but it can also be due to vm.max_map_count being too low which can be queried by sysctl vm.max_map_count. (This is in fragment.openStorage)
In case of mmap failing, it should be possible to fall back to reading the file into memory normally (e.g. ioutil.ReadAll), and proceeding from there as usual. Some state will need to be kept so that when the fragment is closed it doesn't try to unmap the file.
Note:
There is a lot of potential follow-on work to this - handling file handle exhaustion more gracefully, keeping only "hot" fragments mapped or in-memory, while others get read in on-demand, etc. This ticket is not for that work, though we should keep it in mind.
Success criteria (What criteria will consider this ticket closeable?)
When max_map_count is reached and the mmap call throws an error, Pilosa should log a warning and then continue by reading the file into memory the old fashioned way. Insufficient max_map_count should not cause Pilosa to misbehave or fail to make progress.

if actual memory is insufficient for a mmap why do you think there would be memory available for just "reading"

in the case we've actually seen this happen, there was sufficient memory, but there is a kernel param called vm.max_map_count which limits the number of active memory maps you can have. This seems to be what was exhausted.

fixed by #1903


Add comparison methods to rich Text

Text could use comparison methods for this use case: https://github.com/Textualize/textual/issues/2261
Comparisons should treat strings and Text in the same way. This will allow sorting of Text objects.

I'm on this, thanks for opening @willmcgugan

Great. Let me know of you have any questions.


NOT SUPPORT PERSIAN FONT

vs code not supporting persian font for copy and paste

Duplicate of #146354 or #99589


Replace pipenv with poetry

I should probably update the openup cookiecutter if this is a change we wanna make.

I need to test this a little more before I'm comfortable merging it, but I'm 100% open to feedback in the mean time.

Thanks!
Now it doesn't find deps. I'll take a look later this evening, but it's easy o reproduce with
docker-compose run --rm web python manage.py
Creating procurement-portal-backend_web_run ... done
Traceback (most recent call last):
  File "manage.py", line 10, in main
    from django.core.management import execute_from_command_line
ModuleNotFoundError: No module named 'django'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "manage.py", line 21, in <module>
    main()
  File "manage.py", line 12, in main
    raise ImportError(
ImportError: Couldn't import Django. Are you sure it's installed and available on your PYTHONPATH environment variable? Did you forget to activate a virtual environment?

Looks like a timeout on wait-for-postgres would save a bunch of time :)

Adding a timeout to postgres is a good idea.
I think we might be able to just do:
-  - docker-compose run --rm web bin/wait-for-postgres.sh python manage.py migrate
+  - docker-compose run --rm web timeout 300s bin/wait-for-postgres.sh python manage.py migrate

Or add it to wait-for-postgres.sh itself.


Add minimal example of using webpack and pdfkit together

Hi @devongovett. I was able to make webpack and pdfkit work together and hope you can add it to the documentation. Here's the repo of my minimal example. I can make a PR if you want.

JJust a FYI for anyone having issues , I found the example doesn't work . But when I use the pre-built pdfkit and blob-stream files it does.
Here are the urls
https://github.com/devongovett/blob-stream/releases
https://github.com/devongovett/pdfkit/releases

@tzs34 I commented on the issue you opened on my repo asking for more info but haven't gotten a reply from you. Would you mind responding to that? The repo has 7 stars so it does work for some people.

@tzs34 can you provide how you got it working with the released files?

https://github.com/foliojs/pdfkit/tree/master/examples/webpack


No card has precondition of usage defined, implement it

Each card should have a precondition which should be checked before the game_state proceed with the usage of this card.
Ideally the precondition takes the game_state and card_instruction, returning a boolean indicating if the usage is legal.
If the game_state cannot proceed because the precondition is not satisfied, return None or raise Exception. (return None is better)

Already implemented  by me now.


InaccessibleTensorError: The tensor 'Tensor("Tile:0", shape=(None, 3), dtype=float32)' cannot be accessed here: it is defined in another function or code block.

System information

Have I written custom code: Yes
OS Platform and Distribution (e.g., Linux Ubuntu 16.04): MacOS
Mobile device: No
TensorFlow installed from: binary
TensorFlow version: 2.1.0
Python version: 3.6.9
CUDA/cuDNN version: None
GPU model and memory: None

Describe the current behavior
Throws the error.
Describe the expected behavior
Returns a tensor of shape (2, 6, 3), e.g.
tf.Tensor(
[[[0.4200933  0.51168334 0.13771784]
  [0.4200933  0.51168334 0.13771784]
  [0.4200933  0.51168334 0.13771784]
  [0.31555724 0.80608404 0.38079023]
  [0.31555724 0.80608404 0.38079023]
  [0.22353566 0.7539935  0.28550136]]

 [[0.3753245  0.10351241 0.61035573]
  [0.51126313 0.4842764  0.5390732 ]
  [0.1071049  0.8601215  0.69413567]
  [0.1071049  0.8601215  0.69413567]
  [0.         0.         0.        ]
  [0.         0.         0.        ]]], shape=(2, 6, 3), dtype=float32)

Standalone code to reproduce the issue
import tensorflow as tf
@tf.function(input_signature=[
        tf.TensorSpec(shape=(None, None, 3), dtype=tf.float32),
        tf.TensorSpec(shape=(None, None, 1), dtype=tf.int32),
    ])
def some_fz(x, dims):
    batch_size = tf.shape(x)[0]
    seq_len = tf.shape(x)[1]
    dims = tf.cast(tf.math.round(dims), tf.int32)
    new_lengths = tf.reduce_sum(dims, axis=1)
    max_dim = tf.math.reduce_max(new_lengths)
    pad_sizes = max_dim - new_lengths
    new_batch = []
    x = tf.expand_dims(x, axis=-2)
    for i in tf.range(batch_size):
        tensor_list = []
        for j in tf.range(seq_len):
            tiled = tf.tile(x[i][j], [dims[i][j][0], 1])
            tensor_list.append(tiled)
        new_tensor = tf.concat(tensor_list, axis=0)  # breaks here
        new_tensor = tf.pad(new_tensor, [[0,pad_sizes[i][0]], [0,0]])
        new_batch.append(new_tensor)
    return tf.stack(new_batch)

if __name__ == '__main__':
    random = tf.random.uniform([2, 3, 3])
    vector = tf.constant([[[3], [2], [1]], [[1], [1], [2]]])
    out = some_fz(random, vector)

Other info / logs
Traceback (most recent call last):
  File "/Users/fcardina/Library/Preferences/PyCharmCE2019.2/scratches/scratch_2.py", line 58, in <module>
    out = some_fz(random, new_dimension)
  File "/Users/fcardina/anaconda3/envs/ttsTF/lib/python3.6/site-packages/tensorflow_core/python/eager/def_function.py", line 568, in __call__
    result = self._call(*args, **kwds)
  File "/Users/fcardina/anaconda3/envs/ttsTF/lib/python3.6/site-packages/tensorflow_core/python/eager/def_function.py", line 615, in _call
    self._initialize(args, kwds, add_initializers_to=initializers)
  File "/Users/fcardina/anaconda3/envs/ttsTF/lib/python3.6/site-packages/tensorflow_core/python/eager/def_function.py", line 497, in _initialize
    *args, **kwds))
  File "/Users/fcardina/anaconda3/envs/ttsTF/lib/python3.6/site-packages/tensorflow_core/python/eager/function.py", line 2389, in _get_concrete_function_internal_garbage_collected
    graph_function, _, _ = self._maybe_define_function(args, kwargs)
  File "/Users/fcardina/anaconda3/envs/ttsTF/lib/python3.6/site-packages/tensorflow_core/python/eager/function.py", line 2703, in _maybe_define_function
    graph_function = self._create_graph_function(args, kwargs)
  File "/Users/fcardina/anaconda3/envs/ttsTF/lib/python3.6/site-packages/tensorflow_core/python/eager/function.py", line 2593, in _create_graph_function
    capture_by_value=self._capture_by_value),
  File "/Users/fcardina/anaconda3/envs/ttsTF/lib/python3.6/site-packages/tensorflow_core/python/framework/func_graph.py", line 978, in func_graph_from_py_func
    func_outputs = python_func(*func_args, **func_kwargs)
  File "/Users/fcardina/anaconda3/envs/ttsTF/lib/python3.6/site-packages/tensorflow_core/python/eager/def_function.py", line 439, in wrapped_fn
    return weak_wrapped_fn().__wrapped__(*args, **kwds)
  File "/Users/fcardina/anaconda3/envs/ttsTF/lib/python3.6/site-packages/tensorflow_core/python/framework/func_graph.py", line 968, in wrapper
    raise e.ag_error_metadata.to_exception(e)
tensorflow.python.framework.errors_impl.InaccessibleTensorError: in converted code:

    /Users/fcardina/Library/Preferences/PyCharmCE2019.2/scratches/scratch_2.py:47 some_fz  *
        new_tensor = tf.concat(tensor_list, axis=0)
    /Users/fcardina/anaconda3/envs/ttsTF/lib/python3.6/site-packages/tensorflow_core/python/util/dispatch.py:180 wrapper
        return target(*args, **kwargs)
    /Users/fcardina/anaconda3/envs/ttsTF/lib/python3.6/site-packages/tensorflow_core/python/ops/array_ops.py:1516 concat
        return identity(values[0], name=name)
    /Users/fcardina/anaconda3/envs/ttsTF/lib/python3.6/site-packages/tensorflow_core/python/util/dispatch.py:180 wrapper
        return target(*args, **kwargs)
    /Users/fcardina/anaconda3/envs/ttsTF/lib/python3.6/site-packages/tensorflow_core/python/ops/array_ops.py:267 identity
        ret = gen_array_ops.identity(input, name=name)
    /Users/fcardina/anaconda3/envs/ttsTF/lib/python3.6/site-packages/tensorflow_core/python/ops/gen_array_ops.py:3829 identity
        "Identity", input=input, name=name)
    /Users/fcardina/anaconda3/envs/ttsTF/lib/python3.6/site-packages/tensorflow_core/python/framework/op_def_library.py:742 _apply_op_helper
        attrs=attr_protos, op_def=op_def)
    /Users/fcardina/anaconda3/envs/ttsTF/lib/python3.6/site-packages/tensorflow_core/python/framework/func_graph.py:591 _create_op_internal
        inp = self.capture(inp)
    /Users/fcardina/anaconda3/envs/ttsTF/lib/python3.6/site-packages/tensorflow_core/python/framework/func_graph.py:641 capture
        % (tensor, tensor.graph, self))

    InaccessibleTensorError: The tensor 'Tensor("Tile:0", shape=(None, 3), dtype=float32)' cannot be accessed here: it is defined in another function or code block. Use return values, explicit Python locals or TensorFlow collections to access it. Defined in: FuncGraph(name=while_body_59, id=5613077840); accessed from: FuncGraph(name=while_body_37, id=5612708472).

I tried to declare the list outside of the first loop, but it won't access the elements then. Doing tensor_list[i] would throw
TypeError: list indices must be integers or slices, not Tensor

I tried what is suggested here:
https://github.com/tensorflow/tensorflow/issues/37512#issuecomment-600776581
But neither solution works. The first needs the lists to have the same size. The second complains that tf.autograph.experimental.set_loop_options has no shape_invariants argument.

Was able to reproduce the error with TF v2.2 and TF-nightly. Please find the attached gist. Thanks!

I'm hoping that in a future version we'll support the plain list version, because right now things are a bit clunky to use.
For the first solution, the trouble in this case seems to be that TensorArray only supports elements of the same shape. But I think we can make it work by tiling inside the array and avoiding the tf.tile. I'm not sure this does exactly what you need, but here's a version that produces results:
    new_batch = tf.TensorArray(tf.float32, size=batch_size)
    x = tf.expand_dims(x, axis=-2)
    for i in tf.range(batch_size):
        tensor_list = tf.TensorArray(tf.float32, size=0, dynamic_size=True)
        for j in tf.range(seq_len):
            # tiled = tf.tile(x[i][j], [dims[i][j][0], 1])
            for k in tf.range(dims[i][j][0]):
              tensor_list = tensor_list.write(tensor_list.size(), x[i][j])
        new_tensor = tensor_list.stack()
        new_tensor = tf.pad(new_tensor, [[0,pad_sizes[i][0]], [0,0], [0, 0]])
        new_batch = new_batch.write(i, new_tensor)
    return new_batch.stack()

The second solution only works in TF 2.2 (that's when set_loop_options was added). I fudged the example by hardcoding some shapes, you'd need to use the proper ones in those tf.zeros and shape_invariants:
    new_batch = tf.zeros([0, 6, 3])
    x = tf.expand_dims(x, axis=-2)
    for i in tf.range(batch_size):
        tf.autograph.experimental.set_loop_options(
            shape_invariants=[(new_batch, tf.TensorShape([None, 6, 3]))]
        )
        tensor_list = tf.zeros([0, 3])
        for j in tf.range(seq_len):
            tf.autograph.experimental.set_loop_options(
                shape_invariants=[(tensor_list, tf.TensorShape([None, 3]))]
            )
            tiled = tf.tile(x[i][j], [dims[i][j][0], 1])
            tensor_list = tf.concat([tensor_list, tiled], axis=0)
        new_tensor = tf.pad(tensor_list, [[0,pad_sizes[i][0]], [0,0]])
        new_tensor = tf.expand_dims(new_tensor, 0)
        new_batch = tf.concat([new_batch, new_tensor], axis=0)
    return new_batch

Hi,
thanks, that works. Quite clunky indeed.
I did not realize that one of the issues was with the variable that defines the (outer) loop.
Here are some examples of what work and what doesn't (counter intuitively, I' say)
This does NOT work
@tf.function(input_signature=[
    tf.TensorSpec(shape=(None), dtype=tf.int32),
    tf.TensorSpec(shape=(None), dtype=tf.int32),
])
def foo(variable, loop_constant):
    a_list = []
    some_constant = 4
    the_tensor = tf.ones(some_constant)
    for i in range(loop_constant):
        t = tf.random.shuffle(the_tensor)
        a_list.append(t)
    return a_list

This DOES work, but it's obviously not acceptable
@tf.function(input_signature=[
    tf.TensorSpec(shape=(None), dtype=tf.int32),
    tf.TensorSpec(shape=(None), dtype=tf.int32),
])
def foo(variable):
    a_list = []
    some_constant = 4
    loop_constant = 5
    the_tensor = tf.ones(some_constant)
    for i in range(loop_constant):
        t = tf.random.shuffle(the_tensor)
        a_list.append(t)
    return a_list

This works and it's acceptable. Interestingly everything is defined within the same scope as the first example. I hope this becomes more pythonic in the future.
@tf.function(input_signature=[
    tf.TensorSpec(shape=(None), dtype=tf.int32),
    tf.TensorSpec(shape=(None), dtype=tf.int32),
])
def foo(variable, loop_constant):
    a_list = tf.TensorArray(tf.float32, size=loop_constant)
    some_constant = 4
    the_tensor = tf.ones(some_constant)
    for i in range(loop_constant):
        t = tf.random.shuffle(the_tensor)
        a_list = a_list.write(i, t)
    return a_list.stack()

Regarding the original question:
I ended up using this, in case someone has the same issue and looks for an alternative.
    def call(self, x, dimensions):
        dimensions = tf.squeeze(dimensions)
        dimensions = tf.cast(tf.math.round(dimensions), tf.int32)
        seq_len = tf.shape(x)[1]
        batch_size = tf.shape(x)[0]
        # build masks from dimensions
        max_dim = tf.math.reduce_max(dimensions)
        tot_dim = tf.math.reduce_sum(dimensions)
        index_masks = tf.RaggedTensor.from_row_lengths(tf.ones(tot_dim), tf.reshape(dimensions, [-1])).to_tensor()
        index_masks = tf.cast(tf.reshape(index_masks, (batch_size, seq_len * max_dim)), tf.float32)
        non_zeros = seq_len * max_dim - tf.reduce_sum(max_dim - dimensions, axis=1)
        # stack and mask
        tiled = tf.tile(x, [1, 1, max_dim])
        reshaped = tf.reshape(tiled, (batch_size, seq_len * max_dim, self.model_dimension))
        mask_reshape = tf.multiply(reshaped, index_masks[:, :, tf.newaxis])
        ragged = tf.RaggedTensor.from_row_lengths(mask_reshape[index_masks > 0], non_zeros)
        return ragged.to_tensor()

was able to reproduce the issue in TF 2.5 and Nightly versions. Please find the gist here.Thanks!

Hi,
Thank you for opening this issue. Since this issue has been open for a long time, the code/debug information for this issue may not be relevant with the current state of the code base.
The Tensorflow team is constantly improving the framework by fixing bugs and adding new features. We suggest you try the latest TensorFlow version with the latest compatible hardware configuration which could potentially resolve the issue. If you are still facing the issue, please create a new GitHub issue with your latest findings, with all the debugging information which could help us investigate.
Please follow the release notes to stay up to date with the latest developments which are happening in the Tensorflow space.


Add more explanation for tzOffset in README.md

First so thank you for this project.
tzOffset is based minute
At first, I confused when I set tzOffset 9. "Why don't appear any chages?"
When I saw SkedTape.js internal, I knew it. tzOffset is working for minute.
So If you ok to add a little mention for tzOffset. that is good to other people.

Apparently it's the standard
https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Global_Objects/Date/getTimezoneOffset
I was confused as well with the params :))

Apparently it's the standard
https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Global_Objects/Date/getTimezoneOffset
I was confused as well with the params :))

Thank you !


News feed

-rowDoubleClicked prop passed to grid in DataView
-store prop made optional in StoreFilterField

Updating this PR title to reflect what was done at the hoist-react level. (It's very helpful to have clear / accurate titles when reviewing what went into a given release - thanks!)


Changes for Grafana 8.x

Changes as discussed in https://community.openhab.org/t/influxdb-grafana-persistence-and-graphing/13761/954

Using /d-solo/ paths seems to be a better replacement. I've created a draft PR #32 using that replacement.


Inferable vs non-inferable jumps needs to a lot more detail

In earlier chapters, the spec is narrow about uninferable jumps in the sense that it doesn't mention constant registers.
In the ingressPort chapter, it says that indirect jumps with constant-loaded registers are also an inferable jump. That makes sense.
But since it's the core (through itype), not the encoder, that determines which jump is inferable  and which one is not, this needs to be very precisely specified. Because the decoder will need to be ready to understand constant registers load exactly the same way the core does.
Right now, this is not the case.
The spec needs details about what is considered a constant register load.

Is it only for cases LUI and AUIPC instructions? Load immediate instructions should be considered as well. I assume that operations on constant loaded registers (shift-immediate, add/subtract-constant) are excluded, even though they could qualify...
Are there restrictions on how far away the LUI and AUIPC instructions are located from the jump instruction?
What kind of barriers will invalidate constant loaded registers? Are inferably jumps out? Branch instructions should be fine in theory, except when there are multiple non-taken branches in the same instruction block.

I expect that the answer to all these points will be pretty straightforward: some simple 'constant' status bit per register inside the core that gets set to 1 in case of an AUIPC/LUI/load-immediate, and that gets cleared for any operations, branch, or jump.
But it needs to be specified.
Tom

Tom,
See inline…
Iain
From: Tom Verbeure<EMAIL_ADDRESS>Sent: 06 September 2019 18:24
To: riscv/riscv-trace-spec<EMAIL_ADDRESS>Cc: Subscribed<EMAIL_ADDRESS>Subject: [riscv/riscv-trace-spec] Inferable vs non-inferable jumps needs to a lot more detail (#28)
In earlier chapters, the spec is narrow about uninferable jumps in the sense that it doesn't mention constant registers.
In the ingressPort chapter, it says that indirect jumps with constant-loaded registers are also an inferable jump. That makes sense.
[Iain] Yes, I thought so too when I wrote it.
But since it's the core, not the encoder, that determines which jump in inferable and which one is not, this needs to be very precisely specified. Because the decoder will need to be ready to understand constant registers load exactly the same way the core does.
Right now, this is not the case.
[Iain] Agreed.
The spec needs details about what is considered a constant register load.
·         Is it only for cases LUI and AUIPC instructions? Load immediate instructions should be considered as well. I assume that operations on constant loaded registers (shift-immediate, add/subtract-constant) are excluded, even though they could qualify...
·         Are there restrictions on how far away the LUI and AUIPC instructions are located from the jump instruction?
·         What kind of barriers will invalidate constant loaded registers? Are inferably jumps out? Branch instructions should be fine in theory, except when there are multiple non-taken branches in the same instruction block.
[Iain] I think it should only be AUIPC, LUI and C.LUI.  This is the mechanism built into the ISA for forming long distance jumps.  I don’t believe it is worth the additional complexity in terms of design and verification or the CPU, the encoder and the decoder to support other types of constant load, as I don’t believe they will occur often enough to make a meaningful difference to the encoder efficiency.  Furthermore, the interface between CPU and encoder will need to be considerably more complex to support the general case of any constant-load.  It will require all the state about which register contains a constant, and which register is used for the jump target to be visible to the encoder.
I expect that the answer to all these points will be pretty straightforward: some simple 'constant' status bit per register inside the core that gets set to 1 in case of an AUIPC/LUI/load-immediate, and that gets cleared for any operations, branch, or jump.
But it needs to be specified.
Tom
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHubhttps://github.com/riscv/riscv-trace-spec/issues/28?email_source=notifications&email_token=ALQOPSUAYOS5UGOMOSQGK7DQIKG25A5CNFSM4IULI372YY3PNVWWK3TUL52HS4DFUVEXG43VMWVGG33NNVSW45C7NFSM4HJ3PIOQ, or mute the threadhttps://github.com/notifications/unsubscribe-auth/ALQOPSTVBQVCRQDDKX5ZKL3QIKG25ANCNFSM4IULI37Q.
The information in this email is confidential and is intended solely for the recipient. Access, copying or re-use of information in it by anyone else is unauthorized. If you are not the intended recipient, please inform the sender by reply or contact UltraSoC on +44 (0)1223 422133, and then delete the email.

[Iain] I think it should only be AUIPC, LUI and C.LUI.  This is the mechanism built into the ISA for forming long distance jumps.  I don’t believe it is worth the additional complexity in terms of design and verification or the CPU, the encoder and the decoder to support other types of constant load, as I don’t believe they will occur often enough to make a meaningful difference to the encoder efficiency.

Sounds good!
What about the location of AUIPC/LUI/C.LUI?
Shall a jump only be considered inferable when these 3 instructions are located right before the jump (as, I think, is currently assumed in the reference C decoder) ?
I'm fine with that restriction as well, since it's pretty much a standard instruction combo in the ISA spec.

Furthermore, the interface between CPU and encoder will need to be considerably more complex to support the general case of any constant-load.  It will require all the state about which register contains a constant, and which register is used for the jump target to be visible to the encoder.

I don't think the interface would need to be more complex, since it's the core that determines which register is still constant and which one is not, and the encoder simply takes that at face value? But the decoder would need to have a similar complexity.
Either way, the point is moot.
Tom

Tom,
See inline…
Iain
From: Tom Verbeure<EMAIL_ADDRESS>Sent: 09 September 2019 17:21
To: riscv/riscv-trace-spec<EMAIL_ADDRESS>Cc: Iain Robertson<EMAIL_ADDRESS>Comment<EMAIL_ADDRESS>Subject: Re: [riscv/riscv-trace-spec] Inferable vs non-inferable jumps needs to a lot more detail (#28)
[Iain] I think it should only be AUIPC, LUI and C.LUI. This is the mechanism built into the ISA for forming long distance jumps. I don’t believe it is worth the additional complexity in terms of design and verification or the CPU, the encoder and the decoder to support other types of constant load, as I don’t believe they will occur often enough to make a meaningful difference to the encoder efficiency.
Sounds good!
What about the location of AUIPC/LUI/C.LUI?
Shall a jump only be considered inferable when these 3 instructions are located right before the jump (as, I think, is currently assumed in the reference C decoder) ?
[Iain] No, I think it’s quite likely that compilers will pull the AUIPC earlier so that the register contents are available for use by the jump immediately.  If the AUIPC is right before the jump there will be a stall as the jump is dependent on the AUIPC completing, and the pipelined nature of virtually any implementation will mean this will take several cycles.
(You’re correct that this is what the reference decoder currently does, because that is what UltraSoC’s encoder HW currently does too.  But it needs revising.)
I'm fine with that restriction as well, since it's pretty much a standard instruction combo in the ISA spec.
Furthermore, the interface between CPU and encoder will need to be considerably more complex to support the general case of any constant-load. It will require all the state about which register contains a constant, and which register is used for the jump target to be visible to the encoder.
I don't think the interface would need to be more complex, since it's the core that determines which register is still constant and which one is not, and the encoder simply takes that at face value? But the decoder would need to have a similar complexity.
[Iain] It most definitely would be more complex - see the “Jump Classification Issue” thread.  I’ll happily explain further if that doesn’t answer your questions.
Either way, the point is moot.
Tom
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHubhttps://github.com/riscv/riscv-trace-spec/issues/28?email_source=notifications&email_token=ALQOPSUSI52LX6U5IDDQL6DQIZZWHA5CNFSM4IULI372YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD6IGKLQ#issuecomment-529556782, or mute the threadhttps://github.com/notifications/unsubscribe-auth/ALQOPSSD2HXNYO7LU4BOMK3QIZZWHANCNFSM4IULI37Q.
The information in this email is confidential and is intended solely for the recipient. Access, copying or re-use of information in it by anyone else is unauthorized. If you are not the intended recipient, please inform the sender by reply or contact UltraSoC on +44 (0)1223 422133, and then delete the email.

[Iain] No, I think it’s quite likely that compilers will pull the AUIPC earlier so that the register contents are available for use by the jump immediately.  If the AUIPC is right before the jump there will be a stall as the jump is dependent on the AUIPC completing, and the pipelined nature of virtually any implementation will mean this will take several cycles.

I don't think this is something to worry about because the AUIPC/JALR combo was listed as a macro-op fusion candidate in the 2016 macro-op fusion presentation and because the RISC-V ISA spec hints to that as well (see footnote below table 2.1 on page 17 of the 2.2 version.)
But it's obviously not a big deal to support cases where they are not back-to-back.
Tom

Resolved


vertex creation fails silently if field value is not quoted properly

OrientDB 2.2.0-SNAPSHOT develop@r76eb89664869753ee518b741fd2009d2255877c8
i made a typo while trying to create a vertex using console. the field "id" value quote is not closed. the command silently completes without throwing any error but no record is created:
orientdb {db=testdb}> create vertex c1 set id="13

orientdb {db=testdb}> select from c1

0 item(s) found. Query executed in 0.003 sec(s).
orientdb {db=testdb}> desc c1

CLASS 'C1'

Records..............: 0
Super classes........: [V]
Default cluster......: c1 (id=17)
Supported clusters...: c1(17), c1_1(18), c1_2(19), c1_3(20)
Cluster selection....: round-robin
Oversize.............: 0.0

i have the same issue with the insert command too:
orientdb {db=testdb}> insert into c1 set id="23

orientdb {db=testdb}> select from c1

0 item(s) found. Query executed in 0.002 sec(s).
orientdb {db=testdb}>

Hi @nagarajasr
I'm on it, the fix will be available in short
Thanks
Luigi

Hi @nagarajasr
I just pushed a fix on both 2.1.x and develop branches
Thanks
Luigi


stepi vs lossi plot bug fixed in makemore2 mlp notebook

To keep track of training steps and loss you initialised lossi and stepi lists. Then while running the training loop multiple times loss was appended to lossi correctly, but you were appending i to stepi and that restarting from 0 again. Hence when you ran the training loop multiple times in the video, the loss was appended but with duplicate steps.
####################################
To keep track of actual steps I did:
step = 0     # initialise
for i in range(50000):
step += 1
stepi.append(step)
instead of:
for i in range(50000):
stepi.append(i)
#####################################
I have uploaded the plots with incorrect and correct step tracking. I ran the training loop 2 times in both cases with 50000 training steps each time. But one plot is only showing 50000 steps instead of 100000 steps.

These are the plots I am talking about. Both have been run for 100000 epochs

Sorry for a messy pull request I am still learning.


Make further topics obviously different

🚀 Pull Request
Description

A very simple way to make it obvious in a TOC-tree that Further Topics is not just a page, but a subsection of its own.
I chose to edit the title itself, rather than an alias in the existing TOC-tree, so that this will also apply if included in other TOC-trees. I also kinda like the title being this way 😁

Consult Iris pull request check list

There maybe an option in the pydata theme to do this.  I will check.

There maybe an option in the pydata theme to do this. I will check.

There is! I'm just checking the blame for why we turned it off originally...

There maybe an option in the pydata theme to do this. I will check.

There is! I'm just checking the blame for why we turned it off originally...

@tkknight looks like this line was introduced when we introduced PyData Theme (#4661). Would you be comfortable with turning it off?
https://github.com/SciTools/iris/blob/2bfaebda62b22d3203cfa737a5f017d68800a5c8/docs/src/conf.py#L294
ref

Try removing this line and rebuild the docs.
https://github.com/SciTools/iris/blob/main/docs/src/conf.py#L294

I like it